Karaoke Forums

Is there a program out there that will go through my files and delete any duplicates?

There may be, but you'll pry have to resort to the old stand by:
djtuck.exe

_________________
[highlight=midnightblue]MrD - KJ/DJ Specialist
Visit MrD on facebook - mrdsentertainment
& on myspace - larrynance[/highlight]

mrdelicious2,

Uh Oh, I did that with No Clone and with File Monkey. Big Mistake.
I had to Dig Out the Originals and put them back on my HD.
I'll Never use a software that automatically Deletes them again.

Today I use KJ File Manager and CDGFix to produce an accurate list
for me to choose from. I especially like CDGFix's List. You click on the
Dup and Compare versions before deleting.

PS If you just want to remove Dup's in a list, use KJ Pro!

Kind Regards,
sw00000p

Yeah, I'm not sure I want to give the software that much control.  At least if you do it by hand, it's easy to own up when something is missing.  MrD

_________________
[highlight=midnightblue]MrD - KJ/DJ Specialist
Visit MrD on facebook - mrdsentertainment
& on myspace - larrynance[/highlight]

KJ Pro songbook software includes the ability to delete dupes with a click.

_________________
"No Contests, No Divas, Just A Good Time!"

" Disc based and loving it..."

I wrote a Perl script that does it. It takes a listing of song by title and artist, and moves  (doesn't delete) the file.
Then I rebuild the database (for Compuhost or Hoster, depending on what it is). For Hoster, I use my Perl script that reads KMA  files and builds a tab-delimited database from them. For MP3+G, I use the disk ID as the directory name, and key off that based on the letter prefix.

In general it is a hard problem to figure out which version you should remove. Short of marking which files are to be saved and/or removed, I don't quite know how you do it. I chose to just remove any versions I considered to be an inferior brand (SGB, SAV?, CKC, BS, Nutech, etc.).

But I have some SGB and SFK versions (We Just Disagree, Doctor My Eyes, etc.) which I like better than the other versions. So I have a whitelist for some disk/track combos. Even then, I forget some and only find out I want that version later.

The program generates a script that moves the files to a mirrored tree of removed files, so they aren't lost, only moved.

But there is no way anyone short of a certified Perl wizard will use what I have. I mention this only in that it shows it can be done programmatically if you know what you are doing.

KJ Pro deletes the items that are written exactly the same.

If it say Teddy Bear by Elvis Presley

And one says Teddy Bear by Presley, Elivis.  Both will remain. Dupe song, not dupe designation.  

Everything down to the last letter and number must be exactly the same for it to be considered a dupe.

It also can remove the tracks that have (/vocals) i.e. demo tracks

I just read your other post.  You want to remove dupes from the karaoke song files, not the song book?

KJ Pro is a song book program.  Has nothing to to with the hard drive files.  You would have to manually remove them.  

But they don't take up that much room.  Big External Hard drives are cheap.  17,000 songs on a 160 gig and it's half full.  What is taking up all your room?

I have over 22,000 songs, on a 250G external.  But when I search for songs on Sax & Dotties, often times (mostly the really popular songs)  I'll get 2 or 3 returns that are all from SC, but different disks/tracks.  I don't mind having different brands of the same song, but if I have 3 Sound Choice versions of a song, I'd rather just have one.

If it is the same company, then manually delete the dupes from the hard drive.

17,000 songs takes up 72 GB

That's 34,000 songs on a 150GB drive.

60,000 on a 250 GB  

By the time you fill that up the 1000GB drives will be selling for $100.

sidewinder,

17,000 songs takes up 72 GB
Over 300,000 available and 72 = 17K?
Some are Very Long Winded, some are super short!
That's Funny!  LOL


Kind Regards,
sw00000p

Depends on the rip obviously - the lower the quality rip, the less space, I have a little over 14K (counting dups 11K w/o) & they take up approx 80gb on my 250gb drive.

_________________
LIKE Lonman on Facebook - Lonman Productions Karaoke & my main site via my profile!

Yeah and even at $1 a song when will you have 300,000 songs? Let your beard grow and you'll look like ZZ TOP.

This is what I did with Sax & Dottie.  It is labor intensive, but gives you complete flexibility with and control over what your database contains.  

Step 1.  Go to the "Program Files" (on the C drive), or wherever you may have actually installed S&D.  Find The "S & D Software" folder.  In that folder you will find the folder labeled "Show Presenter X.X (version number)".  Open up that folder and look for the file (Access.mdb) labeled "Songlist".  Within the "Songlist" file there is a table labeled "KaraokeTracks".  That table contains the database for the S&D show hoster!
Step2.  FOR SAFETY'S SAKE... Right click on the "KaraokeTracks" table and select "copy".   Then rename the copy in the window that appears. I suggest using "KaraokeTracks()"
Step3.  Do all of your editing and redesigning on "KaraokeTracks()".  
Step4.  When you are ready to test what you have accomplished, right click on the original "KaraokeTracks" table and using the Rename function, rename it "Karaoke Tracks(a)"
Step5.  Rename your working (edited) copy of the table as "KaraokeTracks"
Step6.  When you are done you will have two tables; one of which is cleaned up and edited.

CAUTION: UNLESS YOU KNOW EXACTLY WHAT YOU ARE DOING, DO NOTTOUCH THE "TrackPath" FIELD ON THE DATABASE

NOTE (1): You can continue to use the "rename" routine to go back and forth between the database you have cleaned up and the original.  Eventually, if you like, the original can be discarded.  Meanwhile, the actual zip files behind the database do not have to be touched to eliminate duplicates.

NOTE (2): I recommend you sort the database by "Artist" it will facilitate finding songs by a specific artist that have been duplicated.  I also recommend that before completing this task with any specific artist, you search through the S&D hoster to see if there may be other listings which utilize "the" or have way off spellings that are not sequentially listed on the database near the artist's name

NOTE (3)  If you are desireous of eliminating duplicated tracks but intend to leave duplicated songs, you have the option to enter/add "best version" after the song title in the "Track Name" field

NOTE (4) I must also note, that while I've never participated in one, I believe there is a user group for S&D software.

If you have KJ File Manager you can use the find duplicate tool, select the filter you want to use and then search. Then you can leave one original of each and highlight the duplicates and either delete (I would not recommend to do this yet) or move (you could set up a duplicate folder and move the duplicates there).
Then when you do your song book you simply would not include the duplicate folder and after time (and if you really need the space) you could then delete the duplicates, having said that though, as has been stated many times on this forum-storage (hard drives) are cheap, why delete, just tuck away.

_________________
Music speaks to the heart in ways words cannot express.

Thanks for all the advice.  Once I actually get the time, I'll sit down and try some of these techniques.

As for making the song book, the file I use eliminated Dups as it pulled the info.  I just wish there was a program that would do the same with the actuall file folder (either delete or move.)

Thanks

DJTuck

One of the things to be very aware of when using S&D Software is that there are no built-in safeguards against importing duplicate files.  If you import a folder labeled "a", S&D will immediately thereafter, upon command, import the very same folder labeled "a".

However, once you get experienced in dealing directly with the database table noted in my previous post, you can eliminate such a duplicate quite easily

What are you talking about?
When you import your songs into the database YOU direct/select which folders to import not the program.

_________________
Music speaks to the heart in ways words cannot express.

I will say it again, differently. If someone in the process of using S&D has a "brainfart" when importing files and forgets that they had previously imported a particular folder, or is working too quickly and in haste selects a previously imported folder, S&D DOES NOT provide any safeguard to prevent that from happening!

Is there anyone now who is confused by my simple statement dealing with the fact that S&D provides no built-in safeguards from duplicate files being imported?

You don't need to talk down to me about S & D.....I know S & D inside and out.

If you or someone else needs software to protect them when they have a brainfart...well you can get it...just open your wallet.

Your method would work, never said it wouldn't...but it is not the only solution. to DJ Tuck's question.

_________________
Music speaks to the heart in ways words cannot express.