Mdthbs

Packet sniffer for MacOS Mojave and above

Write to EXCEL from SQL DB using VBA script

Visa for volunteering in England

If 1. e4 c6 is considered as a sound defense for black, why is 1. c3 so rare?

Why is the SNP putting so much emphasis on currency plans?

How does NAND gate work? (Very basic question)

Can PCs use nonmagical armor and weapons looted from monsters?

Does hiding behind 5-ft-wide cover give full cover?

What happened to Rhaegal?

How to reply this mail from potential PhD professor?

Disabling Resource Governor in SQL Server

Junior developer struggles: how to communicate with management?

Save terminal output to a txt file

Feels like I am getting dragged into office politics

Was Hulk present at this event?

What happens if I start too many background jobs?

Field Length Validation for Desktop Application which has maximum 1000 characters

Why do computer-science majors learn calculus?

Was Unix ever a single-user OS?

When do aircrafts become solarcrafts?

How did Captain America use this power?

Stark VS Thanos

Can a cyclic Amine form an Amide?

You look catfish vs You look like a catfish?

Linux sort vs programming

Linux sort last columnWhat's the default order of Linux sort?resources for linux programmingsort command in unix with numeric sortSort huge list (130Gb) in LinuxSort files alphabetically with ls on Linux?sort linux in UTF8Sort with field separatorTerminal sort command options: sort -k1,1Trying to sort specific columns in linux

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}

0

I'm trying to grasp why my software (golang) is 350 times slower compared to linux sort command? I was sorting UTF-8 text file around 13.000.000 lines (4 - 20 bytes long).

code sample from my function (if checkDupl false append to newArray):

func checkDupl(in []byte) bool {

    for i := range newArray {

        if bytes.Equal(in, newArray[i]) {

            return true

        }

    }

    return false

}

This code finished around 25% over night.

This code finished in 8min:

  497  export LC_ALL=C

  498  time sort -us -o file_unique.txt file.txt

linux sort

share|improve this question

asked 11 mins ago

Raimonds LindeRaimonds Linde

11

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Without the rest of your code it's a bit hard to tell, but that looks like it's going to be part of an O(N^2) implementation. All other things being the same that will be several hundred thousand times slower for your input size than what sort will do.
  
  – Michael Homer
  6 mins ago
  
  
  

  
  
  
  

add a comment | 

0

I'm trying to grasp why my software (golang) is 350 times slower compared to linux sort command? I was sorting UTF-8 text file around 13.000.000 lines (4 - 20 bytes long).

code sample from my function (if checkDupl false append to newArray):

func checkDupl(in []byte) bool {

    for i := range newArray {

        if bytes.Equal(in, newArray[i]) {

            return true

        }

    }

    return false

}

This code finished around 25% over night.

This code finished in 8min:

  497  export LC_ALL=C

  498  time sort -us -o file_unique.txt file.txt

linux sort

share|improve this question

asked 11 mins ago

Raimonds LindeRaimonds Linde

11

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Without the rest of your code it's a bit hard to tell, but that looks like it's going to be part of an O(N^2) implementation. All other things being the same that will be several hundred thousand times slower for your input size than what sort will do.
  
  – Michael Homer
  6 mins ago
  
  
  

  
  
  
  

add a comment | 

I'm trying to grasp why my software (golang) is 350 times slower compared to linux sort command? I was sorting UTF-8 text file around 13.000.000 lines (4 - 20 bytes long).

code sample from my function (if checkDupl false append to newArray):

func checkDupl(in []byte) bool {

    for i := range newArray {

        if bytes.Equal(in, newArray[i]) {

            return true

        }

    }

    return false

}

This code finished around 25% over night.

This code finished in 8min:

  497  export LC_ALL=C

  498  time sort -us -o file_unique.txt file.txt

linux sort

share|improve this question

asked 11 mins ago

Raimonds LindeRaimonds Linde

11

func checkDupl(in []byte) bool {

    for i := range newArray {

        if bytes.Equal(in, newArray[i]) {

            return true

        }

    }

    return false

}

  497  export LC_ALL=C

  498  time sort -us -o file_unique.txt file.txt

share|improve this question

asked 11 mins ago

Raimonds LindeRaimonds Linde

11

share|improve this question

asked 11 mins ago

Raimonds LindeRaimonds Linde

11

asked 11 mins ago

Raimonds LindeRaimonds Linde

11

asked 11 mins ago

Raimonds LindeRaimonds Linde

11