Eliminating duplicate rows with Mysql?

Question

Eliminating duplicate rows with Mysql?

4 Answers

Related questions

0 like 0 dislike

1 answer

How to request a random row mySQL, eliminating some of the lines?

asked May 11, 2019 by lidiya11

0 like 0 dislike

7 answers

MYSQL. To remove the duplicate rows?

asked Mar 21, 2019 by mihavxc

0 like 0 dislike

5 answers

Problem with MySQL MyISAM — duplicate entries and crash on large tables

asked Mar 21, 2019 by ilya_compman

0 like 0 dislike

3 answers

How to check the entry on the duplicate and add to mysql?

asked Jun 7, 2019 by ell_ninjoalls

0 like 0 dislike

1 answer

Duplicate entries in mysql why?

asked Apr 9, 2019 by ART4

tzlom · Answer 1 · 2019-03-22T15:43:34+0000

definitely in mysql?
if the data in the text file it is possible on the AVC:

awk '!t[$0]++' data.txt

works faster than anything else, returns the first unique string, but will require RAM or virtual memory for the entire array, and is directly proportional to the count of unique rows.
\r
States for dividing a super idea. but Pobjeda order, and also need hands to list all the options, for example the initial letter of the string.
\r

awk '/^[A-F]/ {print $0 >> file1_AF.txt } /^[G-M]/ {print $0 >> file2_GM.txt } ...'

processing each of these files, the same awk filter will require less memory.

bliznezz · Answer 2 · 2019-03-22T15:43:34+0000

The source data is in text files are. Subject to fill.
In General, the index for crude you can add this:
\r

ALTER IGNORE TABLE `test` ADD UNIQUE (`text`)

camokatik · Answer 3 · 2019-03-22T15:43:34+0000

and, i.e. you want to create a database with a unique key and try her importnat all rows?
about particioniranja don't know, I'm such Essentials are not met
assume the hash is not recommended, especially 1-5 words and very short text,MySQL itself will cope with the task

camokatik · Answer 4 · 2019-03-22T15:43:34+0000

Unfortunately, only (no)mysql, there is also razdavlivanija more advanced functionality is needed. Settled on mysql as only worked with her tight and experience an order of magnitude greater than with other DBMS.

Eliminating duplicate rows with Mysql?

Please log in or register to add a comment.

Please log in or register to answer this question.

4 Answers

Please log in or register to add a comment.

Please log in or register to add a comment.

Please log in or register to add a comment.

Please log in or register to add a comment.

Related questions

Most popular tags