Post subject: An alternative AVISynth deduplication plugin: ExactDedup
sgrunt
He/Him
Emulator Coder, Former player
Joined: 10/28/2007
Posts: 1360
Location: The dark horror in the back of your mind
Latest release: ExactDedup 0.03. The 0.03 primarily incorporates changes from Aktan to fix some incompatibilities with AVISynth's Crop() function (and likely other AVISynth functions) and some VirtualDub usage patterns. There is also a 64-bit binary courtesy of Velitha. Previous releases:
  • ExactDedup 0.02 fixes a bug resulting in incorrect timecodes being output for some framerates (such as NTSC NES), and also outputs timecodes to nanosecond precision (as opposed to the microsecond precision of 0.01).
  • ExactDedup 0.01 was the initial release.
--- Our old standby of DeDup only supports YV12 and YUY2 input/output, which doesn't play nicely with our current projects involving YUV444. Having written a console-based filter of this nature which works in RGB24, I thought to myself, "this should be easy enough to improve upon for our purposes". Thus, I present: ExactDedup 0.01. As the name suggests, ExactDedup functions only on exact frame duplicates, which is (not at all coincidentally) what we're looking for in the [wiki EncoderGuidelines]Encoder Guidelines[/wiki], and offers the advantage of (theoretically) working in any colorspace AVISynth supports (though I've only tested it with RGB input/output). It functions in two passes, similar to DeDup; however the timecodes file is generated on the first pass, so you will not need to run the second pass twice to generate the timecodes file before actually encoding the run. If you want to use this as a drop-in replacement for DupMC/DeDup calls, you'll need to:
  • load the plugin (as usual);
  • replace the DupMC call with an ExactDedup(firstpass = true) call; and
  • replace the DeDup call with an ExactDedup(firstpass = false) call.
Further documentation's available in the package; otherwise, feel free to ask questions here about it.
Editor, Player (69)
Joined: 6/22/2005
Posts: 1050
Just to clarify, you need to provide the dupinfo and times files for the first pass and the dupinfo file for the second pass if you're not going to use the default names?
Current Projects: TAS: Wizards & Warriors III.
sgrunt
He/Him
Emulator Coder, Former player
Joined: 10/28/2007
Posts: 1360
Location: The dark horror in the back of your mind
Dacicus wrote:
Just to clarify, you need to provide the dupinfo and times files for the first pass and the dupinfo file for the second pass if you're not going to use the default names?
Correct.
sgrunt
He/Him
Emulator Coder, Former player
Joined: 10/28/2007
Posts: 1360
Location: The dark horror in the back of your mind
Sorry for the double post, but I want to make sure people following this thread see that 0.02 has been released - see [post 293868]the first post of the thread[/post] for details.
Publisher
Joined: 4/23/2009
Posts: 1283
There seems to be a bug in version 0.02 related to using Crop in Avisynth. If you use Crop in your script, I would say wait until this is sorted out before using this. Edit: The bug is due to the fact the plugin does not take into account that a pitch may be bigger than a row, thus comparing values in areas that may not be used. I am trying to get it fix.
sgrunt
He/Him
Emulator Coder, Former player
Joined: 10/28/2007
Posts: 1360
Location: The dark horror in the back of your mind
Bumping to indicate the 0.03 release containing a fix for the above, amongst other things.
Site Admin, Skilled player (1255)
Joined: 4/17/2010
Posts: 11486
Location: Lake Char­gogg­a­gogg­man­chaugg­a­gogg­chau­bun­a­gung­a­maugg
The links above don't work, here's the new mirror, that won't be terminated any time soon. http://code.google.com/p/feos-tas/downloads/detail?name=ExactDedup.dll
Warning: When making decisions, I try to collect as much data as possible before actually deciding. I try to abstract away and see the principles behind real world events and people's opinions. I try to generalize them and turn into something clear and reusable. I hate depending on unpredictable and having to make lottery guesses. Any problem can be solved by systems thinking and acting.
Post subject: Re: An alternative AVISynth deduplication plugin: ExactDedup
Joined: 10/28/2013
Posts: 1
sgrunt wrote:
Further documentation's available in the package; otherwise, feel free to ask questions here about it.
Can anyone post documentation here, please? I am trying to find listing and description of all exactdedup options.
Publisher
Joined: 4/23/2009
Posts: 1283
Post subject: also reuploaded
Publisher
Joined: 4/23/2009
Posts: 1283
Apparently, a new version is out from StainlessS and fixed some bugs and added some features: http://forum.doom9.net/showthread.php?p=1797482#post1797482