ireactions wrote:

As a follow up: if I went with purely QTGMC, what settings would you recommend?

That qtgmc.mkv clip I uploaded was just QTGMC(preset="slower", Sharpness=1.0, FPSDivisor=1) and nothing else.

From the screenshot it looks like the Preset dropdown should contain the "slower" setting.

Sharpness=1.0, that one is in the GUI.

FPSDivisor=1 means double frame rate (60fps) which gives better frame pacing since 24 goes nicer into 60 than 30.

The rest I didn't set which means they are left at default values.  I presume once you select a preset in the GUI it should auto-populate most of the other settings?  Some of the other settings I can't match to anything in the QTGMC wiki, probably just nomenclature differences though.


ireactions wrote:

Or is the TIVTC with QTGMC combination your recommendation?

Using them in combination just means TIVTC will be used 99% of the time, and QTGMC will be used on those 1% rare few sequences that contain combed frames, like the Jeep scene and some bits in the intro sequence.

If you want a smoother look with noise reduction and sharpening, use exclusively QTGMC.

If you want a noisier but higher resolution image, go for TIVTC (I'm then adding a bit of sharpening through my media player's renderer).


ireactions wrote:

what settings do you recommend for the Crop/Resize to avoid losing resolution?

I'm not doing any cropping myself - the edges of the frame seem to be fairly clean.

It looks like you've set the output to square pixels 720x540 which is what I'm using.   Alternatively it is possible to leave the video at its original 720x480, and then flag the video stream with an aspect of 4:3, which the media player should see and know to scale it to a 4:3 size.  I'm not sure which settings in the GUI would produce that though.


ireactions wrote:

Also, for the encoder container: I'm using NVEnc to take advantage of nVidia hardware acceleration. What settings would you recommend for the best quality?

I don't have any experience with NVEnc - my previews were encoded on CPU with ffmpeg command line like this:

ffmpeg -color_range tv -i "C:\MyAvisynthScript.avs" -c:v libx264 -tune film -b:v 10000000 -pix_fmt yuv420p -color_range tv output.mkv
ireactions wrote:

Another question: why output the files to 720x540 instead of 640x480? Which one is the 'native' resolution of the DVD files?

720x480 is the resolution of the MPEG2 video streams on the DVD.  MediaInfo is a great tool for getting this kind of info.

Some episodes appear to be 704x480 pillarboxed within a 720x480 frame.   704x480 is supposed to be the analogue NTSC resolution, and 720x480 the digital one. 

640x480 would discard around 80 lines of resolution in the horizontal.     

ireactions wrote:

For some reason the VidDetect settings are greyed out.

In that case, TDecimate's "hybrid" setting (which frameblends 30fps sequences to 24fps, such as the spinning earths) may not work properly, since "A and B" means TDecimate will only blend 30fps sequences to 24fps if both TDecimate AND TFM agree the sequence is 30fps.   On my system TFM consistently gets it wrong, so I set it to "A or B" to work around it, and then I tell TDecimate to ignore TFM's opinion by setting "hint=false" in TDecimate, but it doesn't seem like that setting is available in the Hybrid app judging by the screenshots.

Alternatively you can avoid all this by just disabling TDecimate's "hybrid" setting, but then the spinning earths will stutter.  But the rest of the show will be smooth and correct since the show is 99% 24fps which doesn't need to be converted anyway.  It's only the odd 30fps sequence that will look better with blending, like the spinning earths, and some other random sequences like when Arturo is seen from the perspective of the ATM machine in Luck of the Draw.  But honestly frame blending can look pretty bad at times on faster pans so I wouldn't stress about getting this feature to work.  MCH's encode doesn't use it either.

Another setting I forgot to mention was TFM's scenethresh which I set to 100 to disable its scene detection which in my experience gets it wrong a lot of the time as well.

I've updated my previous post to include all this extra info.

RussianCabbie_Lotteryfan wrote:

I do think in spite of that the QTGMC is preferred for the reasons you cite here.  It's certainly noticable in comparing the clips you've shared.  And the zoom on that image comparer shows a signficant difference (with streaks running across the detelecine)

Yep, and also there appears to be a drop shadow underneath the top row of brick of the water fountain - I think that might be a field alignment artefact?  QTGMC is smoothing it out.



ireactions wrote:

Hybrid and QTGMC has done a pretty good job of smoothing out the 'jaggies' in "Fever". Those shelves in the pharmacy now look smooth. But I'm wondering if I'm using the best settings. I'd like pneumatic's opinion.

https://i.ibb.co/BKQPkZG/hybrid.jpg

My QTGMC clip was just QTGMC only (nothing else, no other processing like TIVTC) with preset="slower", sharpness="1.0".

My detelecine clip was TIVTC only (TIVTC settings in your GUI screenshot).  I'll try to translate any of my settings which are different to your screenshot:

TFM mode: 2 way match
TFM advanced tab: combing threshold 9 (incorrectly labelled as chroma threshold in GUI)
TFM advanced tab: MI 128
TFM advanced tab: scene threshold 100
TDecimate: hybrid = enabled  *
TDecimate: VidDetect A or B  *
TDecimate: VidThresh 4.5 *
TDecimate: obey TFM hints = false *
TDecimate: Chroma unticked
TDecimate: Denoise ticked (this doesn't denoise the output image, it just does it internally to get better frame metrics)

* if all 4 of these can't be set, then the "hybrid" frameblending feature probably won't work properly, and in this case set hybrid = disabled

In your screenshot it's got QTGMC as the deinterlacer for TFM.  That just means if after the detelecining process there are any combed frames still coming out of it, those will get deinterlaced with QTGMC.  This is needed as there will be the odd sequence here and there which can't be detelecined due to the weird editing they did back in the 90's where they'd often add purely interlaced frames (which can't be detelecined) for the special effects or when splicing in certain scene changes.  The problem is that you get false positives like the Jeep grille etc. which look like interlaced frames to TFM, so those frames end up getting deinterlaced when they could have been detelecined instead.  That's why I set the combing detection threshold higher (MI=128) to try and avoid those false positives, but they still can happen.

Also keep in mind that app you're using appears to be using the Vapoursynth version of those filters, whereas I'm using the Avisynth version.  They should be pretty much identical though, but you never know.

RussianCabbie_Lotteryfan wrote:

@pneumatic 

you mentioned electing to go with the lowest common denominator for consistency reasons rather than handling content on a case by case basis.

i'm wondering, having done some inspection of season 1, what is your sense of the varation between episodes and if you were to group the episodes to tiers (by quality), assuming you have an opinion on this, what would they be?

we've talked on the past here about some of the variation in s1 and have had various theories about it, whether it be in the post production process or just the lighting used when shot.

Funny you should ask as I was just going through season 1 of the Universal R1 DVD to see how many episodes have the field alignment issue.  I'm having trouble figuring out what is actually going on with these episodes.  It seems the field alignment problem presents itself only on certain scenes?  The end credits are consistently clean, so I can't use it as a litmus test.

Another problem I'm having is that inspecting all the episodes is spoiling them for me as I haven't actually watched season 1 yet.

What I might do is view the first 2 or 3 episodes in their entirety to get a better idea of what the image quality is like over the full length of an episode, and re-evaluate.   

In the meantime here is that same preview as before but detelecined instead of QTGMC:
https://drive.google.com/file/d/193II5f … share_link

Some things you might notice:

1. The spinning earths in the intro now have blended frames, as that animation was done at 30fps and the whole video was detelecined to 24fps.  I chose to use frame blending instead of frame skipping otherwise the animation looks too jerky for my taste.  It's possible to create a variable framerate .mkv file to avoid this issue altogether, but it's quite involved and requires a 2-pass process to generate timecode files for the mkv encoder to use. 

2. The Jeep radiator grille at 8mins is twitching because the deteleciner is falsely detecting the grille pattern as a combing artefact, and is reacting by enabling deinterlacing for those few frames.  I have set the combing detection threshold quite high (128 combed pixels within any 16x16 block) but it still gives a false positive.  I can't set it any higher otherwise there will be visible combed frames creeping into the intro sequence due to all the interlaced edits it uses, which need to be detected as combed and deinterlaced.  On the plus side, the Venetian blinds at 10:27 are not producing a false positive like in MCH's encode.

3. Fine details appear sharper and resolve more detail than QTGMC (example) but image is noisier as the noise isn't getting treated by QTGMC's lovely interpolation smoothing.

RussianCabbie_Lotteryfan wrote:

this has upscaling to 720 using that open source software?

No upscaling, except from 720x480 -> 720x540 to convert it to square pixels 4:3 (720/540 = 4/3).

The full script I used for that file was:

# set up source clip
clip = "C:\S01E04.mkv"
video = LWLibavVideoSource(clip, stream_index=-1, repeat=true, cache=true)
audio = LWLibavAudioSource(clip, stream_index=1, cache=true)
AudioDub(video, audio)

# QTGMC deinterlacing
cores=4 
QTGMC(preset="slower", FPSDivisor=1, EdiThreads=cores/2, Sharpness=1.0)

# scale to 4:3 square pixels
LanczosResize(720,540)

# turn on multithreading for performance increase
Prefetch(cores)

RussianCabbie_Lotteryfan wrote:

definitely think you can get gains out of topaz.

Yeah it would be interesting to see what Topaz can do with that file I uploaded.  ireactions mentioned deinterlacing artefacts, but the file I uploaded is progressive, so as long as Topaz is configured to not do any further deinterlacing or detelecining, it shouldn't introduce any new artefacts in that regard.


ireactions wrote:

QTGMC seems superior.

There is an explanation of how it works here: http://avisynth.nl/index.php/QTGMC#Algorithm_Details

On a synthetic test pattern it actually resolves less resolution than detelecine because it doesn't weave fields to progressive frames; it only interpolates them in a very clever way: https://imgsli.com/MTY0MzIx

Note the alternating 1px white and black lines become solid white/black (since an interpolation of white px above and white px below = white) and the converging lines in the circle start to become slightly blurry the closer they get together. 

But that is by design, and season 1 doesn't have a full 480p to resolve anyway due to the field alignment issue, so it is my intention to blur those lines together.  But this is why I wouldn't use it on the later seasons which don't have the field alignment issue - those will have better resolution using delecine instead of QTGMC. 

But, subjectively I still think QTGMC looks very nice in its own unique way.  I especially like that it outputs 60fps as this preserves all the original frame pacing.  You may have noticed the animations in the intro sequence are smoother, like the spinning earths, and a couple of brief 60fps animations at other points.  With detelecine those would get decimated down to 24fps resulting in stutter or frame blending artefacts of those particular animations.  The rest of the show itself is almost always 24fps though so no improvements there - actually QTGMC has slightly worse frame pacing on 24fps sections as the output is 60p which means 3:2 judder.  But I don't really mind that, actually I find it interesting and imbues a certain quality.   edit: and I just remembered QTGMC's output can be converted to 24fps if desired, using its FPSDivisor=2 param which will output 30fps, and then TDecimate can be used on that to remove duplicates to 24. 


RussianCabbie_Lotteryfan wrote:

@pneumatic  -- i see you used the "slower" mode.  have you compared vs. what i presume would be a "slowest" mode?

The 4 slowest modes are: slow, slower, very slow, placebo

The default is "slower", and is what I used for that file.  My i7-4790k (4c/8t @ 4.0ghz) can just barely manage "slower" in realtime (~65fps... so 5fps headroom) but "slow" seems to look pretty much as good and gives some nice headroom at about 90fps so I use that when screening an episode.

For season 1 I'm probably going to just use QTGMC deinterlacer on the lot.  I subjectively like the way it looks and it will keep season 1 looking consistent from episode to episode.  If I try to do special processing on a per-episode basis to extract the most out of each episode, I'll end up with some episodes looking sharper than others.  If I switch to PAL for those episodes, the colour grading of the PAL version can be noticeably different.  I think I'd rather go with the lowest common denominator and keep the whole season looking as consistent as possible, within limits.

Here's a preview (download the file - the version that plays embedded in your web browser is Google's transcode and doesn't represent the quality).  I'd recommend viewing it on a TV at normal viewing distance, if possible.  I'm interested to see how it compares with Topaz as I'm not familiar with that product. The previews on their website seem to be quite impressive though.

67

(31 replies, posted in Sliders Bboard)

RussianCabbie_Lotteryfan wrote:

Question.  What would Quinn's age be today vs. the age of Arturo in the pilot?

I'd imagine ireactions can give the best answer here, but I'd guess Quinn is supposed to be in his mid 20's and the professor in his 50s?   Under this assmption, 2023 Quinn would be approximately the same age as 1995 Arturo.

68

(31 replies, posted in Sliders Bboard)

It's the late 90's, I'm 14 years old, this show "Sliders" randomly appears on TV on a Friday night around 8:30pm.  I was always in a great mood on a Friday night because I hated school.  I vividly recall the scene from the pilot with the traffic lights, and being amazed at how uncanny that must be from his perspective.

The CGI effects were really awesome and cutting edge back then, the portal effect was very special to see.  It was almost like a whole separate reason to be interested in the show, just to see the special effects.   Of course, the stories and characters fell into place perfectly.  Every episode was a new adventure in a new world, the possibilities were endless.  I think it was the perfect show for me at the time.  Everything I could have wanted in a show, at the perfect time on a Friday night.

This also gets me thinking about scheduling and how it plays a role in the viewing experience.  Certain shows seem to lend themselves to certain time slots.  I'm starting to think that even the commerical breaks play a not insignificant role.  After all, these shows were written for ad breaks - the story plays out in segments.  Sometimes it's nice to take a 3 minute breather between segments to refresh your mind, context switch to the real world, then back to the fantasy world again.

ireactions wrote:

It's interesting that you see this blocky pattern on RUGRATS. I've read that the animation was recorded on 35mm film before transferring it to videotape for broadcast. XENA's first season was shot on 16mm film. The blockiness is significantly stronger than on Season 2 of SLIDERS, shot on 35mm film.


https://i.lensdump.com/i/THFfAP.png
https://i2.lensdump.com/i/THFFVm.png

In motion the pattern changes every frame like film grain - is that what you're seeing too?

Weird how they made animation through film back then, I can't even imagine how that would work.

RussianCabbie_Lotteryfan wrote:

Let this inspire us!!

https://www.youtube.com/watch?v=ixPBhkmBHKw

Geoblocked by CBS

RussianCabbie_Lotteryfan wrote:

So that means they did additional processing after ripping the dvd?

In the case of MCH's rip, they would have first detelecined & deinterlaced the DVD's 480i MPEG2 video stream, resulting in progressive frames which were then transcoded to h.264.  Utilities like ffmpeg, handbrake, staxrip etc. can automate this in a one step process, and they appear to be using the free Avisynth filters like TFM, Telecide, TDecimate, Decimate, QTGMC, yadif, bwdif etc. for the detelecine & deinterlacing.   ffmpeg or x264.exe is generally used for the transcoding to h.264.   

ireactions wrote:

One area I'd be very interested in pneumatic's take: Is there something about 1995-era digital videotape that creates odd visual patterns?

I've seen a similar pattern on my Mad About You season 1 PAL DVD and Rugrats on streaming service which appears to be sourced from old 90s masters.   I've got no idea what causes it, it looks a bit like film grain to me, but distorted in some way.  Maybe analogue composite video artefacts interacting with the film grain in some weird way, and then perhaps MPEG2 (DVD) compression interacting with it further.

I think I figured out what MCH is using to smooth out those tree branches at top of frame - this popular deinterlacer called QTGMC. As I am able to replicate the same image quality with QTGMC.

What I think is happening: MCH has set the post-telecine combing detection threshold lower than I have, and as a result of this many frames in that scene are being falsely detected as combed (interlaced), causing QTGMC frames to be substituted for those frames, thereby inadvertently smoothing out the artefacts which are baked into the source.   Whereas my script has combing thresholds set much higher so mine is just weaving fields (detelecine) to progressive frames and showing those frames as is, warts and all. 

The reason I use a higher combing threshold is due to false positives, things like car radiator grilles or clothing with pinstripes can cause the frame to be flagged as combed (interlaced) and trigger QTGMC (or whatever deinterlacer I choose) which doesn't extract as much resolution as detelecine (weaving fields to progressive frames).

By the way QTGMC is effective at suppressing the field alignment issue too, and looks sharper [1][2][3] but introduces moire artefacts on stippled patterns [4].

RussianCabbie_Lotteryfan wrote:

is there any chance that the stretching caused the artifacts to "smooth" out more, and thus be less visable/pixalated?

I don't believe so - that quality of antialiasing requires a lot more than just scaling.

I noticed the cold open for S03E13 Murder Most Foul has similar artefacts baked into the source as well, and they are present in MCH's encode too, so I don't think MCH applied any antialiasing.

If I was forced to bet money on it, I'd say MCH's decimation from 30p->24p just happened to throw out the frames which had the deinterlacing artefacts in them (there's only a handful of them at random parts in that 67 frame sequence, so the chances are not totally miniscule).   Perhaps MCH's decimator was set up to preference cleaner looking frames when deciding which frame to throw away every cycle of 5 frames.  Due to the camera being relatively still, decimator sees 5 frames that are all very similar and has to decide which one is the duplicate to discard.

RussianCabbie_Lotteryfan wrote:

Though the image on the left doesn't start at the left edge side of the frame properly. You will notice a black bar.  So the slider doesn't show the exact same content when you slide to compare... it kinda shifts so makes it a little harder to compare.

Yes, it's because the person who did the encode (MCH) cropped the small ~8px black pillarbox bars down the right and left side, then set the video stream's aspect ratio flag to 4:3 which causes the directshow video renderer to stretch it back to 4:3 at runtime, creating a 1.022% (720/704) wider aspect.   I can correct that manually but it's trivial.

I believe the source frame for both images is the same, because I stepped through 1 frame at time and counted them manually - 67 unique frames for that opening street scene in both mine and MCH's, and we are paused on frame 4 of 67.  I also inspected neighbouring frames and those are all clean in MCH's vesion too.   So whatever MCH has done is some kind of magic that I don't understand.

I set my detelecine filter to debug mode with TFM(display=true) and none of the frames were detected as interlaced, so they aren't being deinterlaced by TFM, therefore TFM is not causing those artefacts.  And I disabled TFM's deinterlacing anyway with TFM(PP=0) so I'm definitely not adding those artefacts. If I do absolutely no video processing at all, the same artefacts are still present, so I am confident they are baked into the source.   

I have no idea how MCH removed them.   Maybe they were removed by fluke as part of the "remove 1 in 5 frames" when decimating the field matched 30p to 24p.  Perhaps that 1 in 5 just happened to land on those problematic frames and remove them?   I tried TDecimate(mode=0/1) which toggles between removing "most similar duplicate" and "last frame in string of duplicates" without improvement.  For this street scene the camera isn't moving very much and all of them are below the CFrameDiff threshold so almost all of them are detected a duplicates, and it has to remove 1 in 5 from the field matched 30p stream created by TFM.

ireactions wrote:

I really, really, really do not understand why anyone would put so much effort into cleaning up the Mill Creek files of Season 1 when they have the Universal NTSC DVDs...

Well, mostly out of curiosity to see if it could be fixed, and then later because we want to also fix those problematic Universal NTSC episodes as well. It seems there are episodes where the field alignment issue is not visible in the end credits text, but IS visible in the live action shots.   Perhaps because the credit fonts are serif'd in such a way that hides it a bit.   The end credits for season 4 use a much thinner font so they won't be able to hide there.  The Mill Creek version has much worse alignment and it shows up on all seasons end credits.

Thanks, it looks like the version I've got is the 2004 release.

Here's a screenshot comparison from the same frame: https://imgsli.com/MTU5NTY2

Note the branches at top of frame - that's not my deinterlacer doing that, it's baked into the video itself.  The shadows of the trees on the road also have deinterlacing artefacts on certain frames visible only when the video is playing, they noticeably "twitch" as lines are occasionally replaced with interpolated fields.  But again that is baked into the source, not my equipment or processing (I disabled all of it to be sure).

So either there is a superior NTSC DVD version out there, or whoever did that transcode somehow smoothed it out.

Jim_Hall wrote:

Technically there's 4 releases of seasons one and two for NTSC. There's 2 complete series sets. One by Mill Creek the other by Universal. Then there's the original Dual Dimension set which features both seasons one and two. Then there was season 1 and season 2 sold separately. Everything looks the same to me except the Mill Creek Version.

Thanks, yep I would expect the Universal releases to all be the same MPEG2 video streams, just as they are for the 2 PAL Universal version's I've got.     

I'm not sure what's going on, either there are multiple Universal NTSCs with different image quality, or whoever did this particular transcode of it is wielding some voodoo magic video processing that I cannot get my head around.

Well, I'm officially stumped.   I'm looking at the opening scene of S01E06 Last Days from the Universal NTSC DVD (disc ISO, not someone else's transcode) and I'm seeing deinterlacing artefacts BAKED INTO the source.  These artefacts are not present in another copy of this episode which was transcoded by someone else.

Is it possible there are multiple Universal NTSC releases, and one of them is superior?

Jim_Hall wrote:

The Mill Creek edition is garbage as far as video quality.

Yep it's pretty bad.  Here's my attempt at cleaning it up so far...

Scene 1 - city square
Scene 2 - forest
Scene 3 - studio
Scene 4 - end credits

To see the actual quality you'll have to download the files and play them with a media player.  The version that plays embedded in your web browser is Google/Youtube's transcode of it, not the original file.

Filters used in this order:

DeCross (reduce analogue rainbow dotcrawl artefacts)
Detelecine to 480p
Deflicker filter (reduce field alignment drop shadow lines)
Convert colourimetry to HD Rec.709
4x AI upscale to 2880x1920p
Downscale & sharpen to 1440x1080p
Slight colour saturation increase

I played around with noise reduction but didn't like the result.  Might have to play around with the thresholds a bit more.

ireactions wrote:

This is very interesting. I wonder if you might come up with something to improve the Universal DVDs when you get them and then I'll follow your script for Episodes 1.02 - 1.09 and run another upscale on the files through Topaz AI.

The only solution I've got currently is the deflicker filter, so all I could do is apply that to the Universal NTSC episodes which have the issue.  Or substitute the PAL version just for those episodes (whichever is better). 

By the way you can do AI (neural network) upscaling in Avisynth too, eg.

nnedi3_rpow2(rfactor=4, nns=1)          # AI upscale 4x (720x480 -> 2880x1920)
BicubicResize(1440, 1080, 0.0, 3.0)     # downscale to 1080p with blur=0.0, sharpness=3.0

https://imgsli.com/MTU5MTA1
https://imgsli.com/MTU5MTAz

edit: there's also a GPU accelerated version of it here (also note the special requirements here) which in my testing appears to be fast enough for real time use:

NNEDI3CL(field=1, nns=1, nsize=0, dh=true, dw=true)     # AI upscale 2x: 720x480 -> 1440x960
NNEDI3CL(field=1, nns=1, nsize=0, dh=true, dw=true)     # AI upscale 2x: 1440x960 -> 2880x1920
BicubicResize(1440, 1080, 0.0, 2.0, -0.5, -1.5)         # downscale to 1080p with sharpening=2.0

Note that when upscaling SD to HD the colourimetry (matrix & gamut) also needs to be converted, otherwise colour hues will be wrong.  It's cheaper to do this prior to the upscale (less pixels to process):

# convert colourimetry from NTSC to HD 
z_ConvertFormat(                        
\ colorspace_op="601:601:170m:full=>709:709:709:full",
\ resample_filter="bicubic",
\ interlaced=true )

Alternatively if your media player is using MadVR you can just tag the file name or parent folder name with [matrix=601][primaries=170M] and this will tell MadVR to decode it with SD NTSC colourimetry (otherwise MadVR would see the resolution of the video is 1080p and infer it uses HD colourimetry).

I've had some time to view the Season 1 Mill Creek episodes on the big screen with the deflicker filter applied, and I think with this filter it is in watchable condition.  It is not good quality by any means, but I think it just passed the threshold from unwatchable to watchable.  The drop shadow lines are absolutely gone.  The weird facial features on actors at a distance are completely gone.  The image certainly isn't as sharp, but it's not out of focus or difficult to look at either.  I am adding a conservative amount of Lumasharpen through the media player's renderer to compensate for the deflicker filter. 

This is the Avisynth script I'm using:

# setup source video
sourcefile = "D:\Video\Series\Sci-Fi\Sliders (Mill Creek DVD)\Season 1\S01E04.mkv"
video = LWLibavVideoSource(source=sourcefile, stream_index=-1, repeat=true, cache=true)
audio = LWLibavAudioSource(source=sourcefile, stream_index=1, cache=true)
AudioDub(video, audio)

# detelecine: field matching to 30p
TFM(mode=0, slow=2, PP=6, cthresh=9, MI=96, scthresh=100, 
\    clip2=bwdif(last, field=-1, thr=2, pass=true))

# detelecine: remove duplicates to 24p
TDecimate(mode=1, cycle=5, cycleR=1, hybrid=1, viddetect=2, vidthresh=4.5,
\    chroma=false, denoise=true, hint=false)

# deflicker filter
nnedi3(field=-2)
Merge(SelectEven(), SelectOdd())

# aspect ratio 4:3 square pixels
LanczosResize(720, 540)

# optional: raise audio volume to highest peak without clipping
# Normalize(1.0)


How to use:

1. Use MakeMKV to dump your original disc to .mkv files.  The Avisynth script will not necessarily work properly on other people's rips, it needs the original interlaced video stream from the disc.

2. Install the latest version of Avisynth+ 64-bit

3. Download the latest version of the filters used by my script: LSMASHSource, bwdif, nnedi3. Drop the 64-bit .dll files into eg. C:\Program Files (x86)\AviSynth+\plugins64.

4. Paste the script into a text file, save it as an .avs file and open it with a media player that supports playing Avisynth files. I'm using MPC-HC with MadVR as the renderer, which can be downloaded as a preconfigured pack here.  To avoid audio sync issues with Avisynth files I had to set MPC-HC to use MPC Audio Renderer instead of the default Sane Audio Renderer (Options > Playback > Output > Audio Renderer > MPC Audio Renderer) .

Well, as long as it doesn't have "millenial writing" I could probably still enjoy it.

Great post - I enjoyed reading it.

ireactions wrote:

What producer wants to add 1994 limitations on top of that?

In my view the limitation can function as its strength.  An example might be retro video games - why would anyone play around with simple blocky 2D graphics when you can have massive 3D worlds?   Because those limited graphics and sound have a certain charm to them.   

ireactions wrote:

What would be the point of producing a 4:3 product for a world of 16:9 televisions?

The way I see it, the 16:9 frame is like a canvas and you can put whatever you want in there.  Framing and composition within the 16:9 frame doesn't necessarily have to be 16:9.   Again, I'm not proposing to put black bars down the sides, I'm only talking about the composition/framing of shots.   What if the director wanted to use a wider aspect like 1.85:1 - is this allowed?

But ultimately it comes down to this: I've never seen a remake that wasn't a shadow of its former self.

Oops, it seems I've completely misused the term "production values" which seems to refer to only the technical things like video and sound quality, costume and set quality, special effects quality etc.   I meant to refer to the artistic side of things, the way the stories are written, the dialogue, the plot pacing, the plot devices, the personalities of characters, their grammar, the composition of the music (instead of its technical aspects like sampling rate, bit depth, number of channels etc.).

Yeah I agree the general public won't accept 4:3, but I don't think they will notice if there are no black borders.   All it does is change the artistic framing/composition of scenes, eg. actors will be standing in the middle of the frame instead of being spread out over the full width of the frame.   

I'm watching Charmed HD remaster (1995 season 1) and it looks to be 4:3 safe with framing of the shots and text overlays being kept within the centre 4:3 zone.  I think it was mostly in that transition period in the 2000's when half of viewers didn't have 16:9 TV's yet so they shot stuff as 4:3 safe to ensure everyone's screens were filled.   

ireactions wrote:

Why would any TV show spend more money to look cheap and dated beyond individual scenes?

Does Sliders looks cheap and dated to you?   Certainly the video quality of the DVD's is cheap and dated (especially season 1 and 2) but if it was rescanned in HD that would still retain the "90's TV show production values" imo.

I would like to see a "spiritual successor" type show that focuses on recreating the same production values as the original.  It should have just enough new ideas to keep it away from remake territory, but enough in common that you can tell it has the same soul.  Maybe some hidden "easter egg" hints that the characters are secretly reincarnations of the original Sliders, perhaps only in some philosophical sense, but never fully disclosed and left mostly to the imagination. 

But the most important thing to me is those 90s TV show production values. The storyboard, the writing, pacing & continuity, the grammar (the way people talk back then is very different to how people talk today) and the soundtrack - those Sliders theme songs which play in the end credits are superb imo.   It should also be shot in "4:3 safe" mode - a full 16:9 frame but all the subject matter is kept within the middle 4:3 zone.  So the framing/composition is still 4:3 but people can't complain about black borders (or you could even overlay borders yourself if so inclined and nothing important to the scene would get cut off).

RussianCabbie_Lotteryfan wrote:

That is great but one thing I noticed is for the letters that were not problematic (e.g. they weren't misaligned) you could argue some of the letters ended up looking  worse (less vibrant in color and softer edges) vs. the original (brighter yellow, and sharper edges, though maybe a bit pixelated).

Yeah I noticed that too.
Here it is vs Universal NTSC : https://imgsli.com/MTU4MDU2

Got the NN scaler working and the results are great: https://imgsli.com/MTU4MDUx

But it's far too slow, about 0.3fps on a GTX 1070 (about 3 days for a 42min episode)

ireactions wrote:

Do you find that Handbrake detelecine is as smudge-producing as your method? Or worse? I assume it's not better since you don't use it.

My screenshots are showing my intentional deflicker smudging filter applied after I've already detelecined.  Detelecine itself shouldn't produce any smudging as it mostly just performs field matching to weave as many field pairs as possible so that you get true 480p resolution frames coming out.   Although I've seen a problem where the frames that come out of the field matching process are double checked for combing in case they contain fields that couldn't be matched to other fields ("orphan fields") and if Handbrake doesn't set the thresholds right (or disable the decombing feature entirely) it can cause false positives.  eg. in this clip (played by your media player not in web browser) at around the 9 second mark notice the aliasing & line twitter on the blinds and upper walls - that would be the decomber falsely detecting those pixels as combed due to the stippled patterns in the blinds.  Other patterns like actors wearing striped/checked shirts, car radiator grills or the rims of a stack of plates in a kitchen scene can set off the decomber too so I like to disable decombing entirely for clean sources, or set the threshold very high so it only triggers when there's lots of combing, or only check n frames either side of scene changes (as this is mostly where orphan fields end up due to the editing equipment in the 90's not making sure every scene ends perfectly at the end of a 3:2 sequence).  Another issue is repeated frames like the one at 11 seconds, that can also be mitigated with the right decimation settings as well.   This is why I want the original discs so I can do my own real-time Avisynth detelecine with my own optimal settings rather than trusting Handbrake or someone else to get it right.


ireactions wrote:

If you can do better cleanup work on the DVD files, I'd be curious about running your results through Topaz AI.

I've been spending some time with the PAL Universal version this evening and I think it's reasonable quality - it's quite a lot better than Mill Creek, on average (season 1 is still a bit meh).  Since Universal NTSC only has a few problematic episodes, perhaps it might be better to just replace those few problematic episodes with the PAL version (detelecined to 25p and then slowed down to 23.976 of course to match the NTSC version, which is trivial to do in Avisynth).   

Regardless, I still want a solution to this issue and it looks like there is a neural net based smoother that works wonders on animation with this field alignment problem, but it might not work on live action scenes very well and I haven't figured out how to actually use it yet (it seems to require python so it would involve reencoding every episode which I really want to avoid).  I'll report back with any findings.

RussianCabbie_Lotteryfan wrote:

Why not then try to add a sharpen thereafter?

Yep, have tried that & found it only gets you so far.  I then tried doing a stronger initial blur to make it seem like all pixels are blurred by the same amount, and then adding very strong amount of sharpening afterwards but the effect was not visually pleasing.  Also tried just throwing away every second field and starting with 720x240 then neural network upscaling the result to various factors like 2x, 4x and then scaling back down to 480p.   Actually the screenshots you are looking at are blended with neural network interpolations but it still looks rough.  I'll keep trying...

Is that Universal or Mill Creek?  Sounds like the saturation may be higher for those later episodes (hard to tell with Mill Creek since it all looks like crap).

Regarding the field misalignment issue, it is possible to smooth it out a little by applying a kind of deflicker filter which works by blending each pixel with the pixel above/below.  Here is what it looks like, not sure if you guys would like it

https://imgsli.com/MTU3OTQ2
https://imgsli.com/MTU3OTQz
https://imgsli.com/MTU3OTQ0  (looks like Quinn has a mustache & Wade has 3 lips)
https://imgsli.com/MTU3OTQ1

I'm not sure if it's the lesser of 2 evils as it does smudge a lot of resolution out of the image.

RussianCabbie_Lotteryfan wrote:

I sent you a email through the forum software and a private message through the PMs about your original request a few weeks ago...;)

Sorry,  looks like I missed it.  I've replied now...

Does anyone know where to buy Season 5 on Universal NTSC DVD?  I can't find it anywhere, even a used copy.   I've already bought the Mill Creek NTSC release but it has the field alignment issue.   I've bought the PAL DVDs but could only get seasons 1-4.   PMs very welcome!

btw I did some experiments in Photoshop and can reproduce the Muck Creek field alignment issue exactly.  Trying to figure out a way to reverse it in Photoshop, then once I know it works in theory it should be translatable to an Avisynth script.  But I'm still not sure if the damage is done in a way that is reversible or not.   It's kind of like lossy vs lossless compression - one of them can be reversed to get a 1:1 copy of the original, the other cannot.   Reversing the field alignment issue may still be lossy.  I think if I knew the exact scaling factor and algorithm they used for the digital zoom which put the fields out of alignment, then maybe I could reverse it 1:1.

So if George Lucas had recoloured Star Wars in a way that you found subjectively appealing, there is no problem with that?

The problem I have is that when they recolour it, they're not just giving you new colours, they're deleting the old colours.  I wouldn't want to delete the new colours either, I'd like to preserve that too for historical purposes. 

The best solution imo is to put the colour grading as metadata in the video stream and let the user choose which version they want: original or new.

I'll add my comment: I do not like it when movies are intentionally color graded in a different way for a new release.  To me it's like taking someone's music and putting a U-shape EQ and compressor on it, and thinking you made it better and that everything is fine.   Then to add insult to injury, they tell you the U-shape is actually "more accurate" because it compensates for people's hearing, or lower listening volume levels, or some irrelevant nonsense that has nothing to do with the original artistic intent.   Changing the source material is wrong for the same reason it's wrong to crop 1.85 movies to 16:9, or zoom in on 4:3 a little bit to reduce the pillarbox bars.    In some cases you can even preserve the artistic intent, but then it turned out that wasn't what got shown on screens anyway cause the equipment they used was adding its own nonlinearities which produced a different look and feel to what the director intended, which then got reified with the movie.   Warner Bros seems to be a particularly bad offender in this regard with many of their backcatalogue being redone in orangeteal with crimson reds, eg. Lethal Weapon.

ireactions wrote:

Sorry to hear PAL has let you down again. Is it just the Season 1 episodes that are poor, or is it all five seasons? Seasons 2 - 5 look great on the German-released Turbine blu-ray which uses the PAL masters.

I've only checked season 1 & 2 so far - takes about 30mins to dump each disc in MakeMKV.   Now that I've got NTSC Universal discs on the way from an ebay USA seller, I just don't feel motivated to spend the hours dumping all the PAL discs with MakeMKV.

ireactions wrote:

Here's a question: does Universal actually have the original negatives at this point?

Well, I remember reading a while back that the MacGyver negatives were lost and that's why there would never be a HD remaster.  Then in 2018 CBS announced they had the film negatives and were remastering it.  So you never know, there could be negatives of Sliders in storage somewhere.   And if there wasn't, there may be copies floating around elsewhere kind of like what happened with Project 4k77.   

The big issue is the time and money taken to scan them in and re-edit all the episodes to splice in the new film frames alongside the frames with CGI which were probably rendered directly to video at 480p.   Kind of like what you mentioned with X-Files, although I remember reading the X-Files HD was done on the cheap with some clever software to automate the colour grading process and it ended up costing less or something.

Another possibility is that there could be "broadcast quality" SD masters sitting in the archives of TV networks.

Got the 2008 Universal PAL release today and sadly it appears identical to the 2013 Via Vision PAL release - the MPEG2 streams have identical file sizes, and MediaInfo reports the same properties for both.    Visually I can see no difference with an A-B comparison in photoshop toggling the second layer on and off.   

The Via Vision PAL box set from 2019 is I believe identical to their 2013 release since the product codes printed on the case spine are the same for both, eg. "VVE454" for season 1 & 2.

Universal NTSC version is still a month away from eBay international shipping, so no Sliders for a few weeks hmm

Universal NTSC packaging is bulky and the cardboard looks a bit tatty in seller's photos, so I'll probably store the discs in the Universal PAL cases.   That way it's still Universal - consistent with the printing on the discs, just a "better" version of Universal smile

I might still keep the PAL discs as a reference in case I come across some odd episode that might be cleaner.

Oh and if you hadn't noticed in the screenshots I posted earlier, the PAL version can also be much dimmer in terms of brightness, so that's another reason to dislike it.

ireactions wrote:

Judging from what pneumatic has said, Universal's home video department converted the Season 1 analog video tapes into DVD with a primitive anti-flicker method for interlaced video, designed to make the image more attractive on CRT televisions.

Just to clarify: at first that's what I thought was happening, but now I think it's a field alignment issue caused by the fields being scaled independently of eachother before being weaved back together.  This effect is "baked into" the source and I'm not sure there's any way to reverse it.


ireactions wrote:

However, I think I may have been muddying the DVD files. I was converting the files from DVD VOB files to MKV with MakeMKV followed by using Handbrake to detelecine the files and get them to h.264 MP4 and then using AVIDemux to increase the colour saturation.

I believe the technical term is "generation loss" - every time it gets re-recorded a bit of quality is lost.  Of course, you could compensate by setting the bitrate very high.   

In my setup I'm using MakeMKV to "remux" the MPEG2 stream on the disc into a mkv file, which doesn't cause any generation loss (it's just copy pasting the MPEG2 stream from disc to mkv file).   Then to play it I write my Avisynth detelecine processing options in a text file and save it with a .avs extension, and open the .avs file with MPC-HC media player and the Avisynth processing gets done in realtime.   This is the highest quality method as it avoids transcoding to another format like x264 which results in some generation loss  (unless you set the bitrate very high... for me it's mostly a convenience thing as encoding video takes a lot of time with my CPU pegged at 100%, and if I want to change something in my Avisynth script, I'd have to re-encode the whole lot).

Here's a comparison on an episode where the Universal version also suffers from field alignment problem (S01E07 The Weaker Sex)

Scene 1: Mill Creek NTSC , Via Vision PAL , Universal NTSC
Scene 2: Mill Creek NTSC , Via Vision PAL , Universal NTSC

Well the 2013 Via Vision PAL DVD is highly disappointing.  In terms of clarity and colour it's about half way between Mill Creek NTSC and Universal NTSC.   Here are some screenshots which are zoomed in 200% nearest neighbour (duplicating each pixel into a square of 4 pixels)...

Scene 1: Mill Creek NTSC , Via Vision PAL , Universal NTSC
Scene 2: Mill Creek NTSC , Via Vision PAL , Universal NTSC

Clarity and colour seems closer to the Universal NTSC release than Mill Creek, but there is another huge issue with the PAL version - the frame rate is inconsistent.  Most of the scenes are sped up to 25p - this would have been fine as it's easy to slow back down to 23.976 in realtime with Avisynth using AssumeFPS(24000, 1001, true) - however many scenes for some inexplicable reason were done at 24p frameblended to 50i, so there is no possibility of detelecining these scenes, and there are a fair few of them.   It sounds like they didn't pitch correct the 25p sections either so the actor's voices get noticeably deeper on those scenes.   

Still have the 2008 Universal PAL release coming in the mail tomorrow, but not getting my hopes up.  I'd anticipate it's exactly the same MPEG2 stream on the 2013 Via Vision PAL release, just with older packaging.   I'll probably chuck the whole lot back on ebay and burn the Mill Creek discs.

edit: managed to scoop a used copy of Universal NTSC off eBay with international shipping - expected delivery date end of March.  Also spotted this rare item, but not sure which release it is exactly.  Probably Universal NTSC?

ireactions wrote:

Why don't the lines show in my detelecined S1 files during playback on my Android TV box? My guess is that it's some combination of the player app or the SoC in the Android TV box.

It's hard to say without seeing a screenshot.  If you detelecined it in Handbrake then all the frames would be progressive and it should look pretty much the same whether its paused or playing, so I'm not sure what's going on there.   Are you able to upload a short clip?

ireactions wrote:

What went wrong with Universal's home video department when they handled SLIDERS? Why are there so many combing artifacts and double line artifacts?

I think Universal's release should look relatively clean if it's optimally detelecined?  I don't have the discs yet, only this transcode which was already detelecined and transcoded to x264 by someone else.  But it looks like pretty clean 480p to me, at least for this one episode (Summer of Love).   edit: after looking at more episodes I found a couple from Universal season 1 and 2 that do in fact have the drop shadow problem on the credits just like the Mill Creek release.

ireactions wrote:

would you have any suggestions for cleaning up these files and engaging in AI upscaling for Episodes 1.02 - 1.09?

The only AI upscaling I've played around with is nnedi3 in Avisynth. I have mixed feelings about it... it's great at antialiasing high contrast edges, but certain shapes sometimes come out looking a bit unusual, like a pattern of small circles might look more like diamonds.

At the moment I'm just using the Lanczos algorithm to upscale which is nothing special, it's kind of like bicubic but slightly sharper.   I'm also adding some modest amount of sharpening through MadVR video renderer, but only for the early seasons - the later seasons I think would look oversharpened if any more was added.  This is all personal preference of course, some people like more sharpening, more noise reduction etc.

ireactions wrote:

I still see the Universal sets for Seasons 1 - 4 on eBay. Season 5 has been hard to find.

Cheers, I just ordered this which appears to be Universal's PAL release.  There were no NTSC versions listed in my region of ebay which I would have preferred.

I suspect the PAL version might actually be NTSC video on the disc though, as I've recently bought DVDs of other US shows that say PAL region 4 on the box but the MPEG2 video on the disc is still 720x480i, eg. The Ray Bradbury Theater & Caroline in the City.

edit: hmm, it seems there are actually 2 different PAL DVD releases in my region: one published by Universal in around 2008, and another published by Via Vision in around 2013.   I am not sure if they both contain the same MPEG2 video streams, so I bought both just to make sure.   I suspect the Via Vision one may be the same video contained in their box set, although the box set has a release date of 2019 which is much later than 2013 so maybe not.   My PAL/R4 versions of Ray Bradbury Theater and Caroline in the City are both Via Vision releases and contain NTSC MPEG2 video streams, for whatever that's worth.

ireactions wrote:

It's good to have an expert looking at this. Where did you acquire your knowledge of video processing?

I'm just an amateur but I learned a lot recently about Avisynth & deinterlacing from some helpful users on Doom9 forum ("THE in-place to be for everyone interested in DVD conversion").

Actually I just realised I've seen these type of double line artefacts before. It can happen when interlaced video is scaled without deinterlacing.   i.e just taking each field of 720x240 and resizing them individually, then weaving them back together into a progressive frame.   It creates this "mice teeth" effect because the fields were resized independently of eachother and don't fit back together quite properly.  I observed this on a recent Bluray release of the show Fawlty towers - https://forum.doom9.org/showpost.php?p= … stcount=71

So my hypothesis is that Mill Creeks version went through this field scaling process at some stage which offset the field structure slightly.   In the screenshots you can see it is zoomed in slightly compared to Universal, maybe that was when it happened.

Here's on an actual scene

Universal
https://i3.lensdump.com/i/Ttfowe.png

Mill Creek
https://i.lensdump.com/i/TtfYza.png

ireactions wrote:

Hmm. I can see what you've screencapped when I hit pause on the detelecined file, but I don't seem to see it when the video file is actually playing on my Android TV box.

Hmm, not sure what's going on. 

Here is the same frame Universal vs Mill Creek:

https://i.lensdump.com/i/Ttfpwr.png

https://i2.lensdump.com/i/TtfKz7.png

I am quite confident this is not a deinterlacing or detelecining artefact, as both have been field matched to weave to a progressive frame.

edit: this is from the end credits of S01E03 Summer Of Love

ireactions wrote:

I've seen the double-line drop shadow type effect on my Universal discs in the Season 1 episodes, and I had to remove them by using Handbrake's detelecine function.

Detelecine (or IVTC as I called it) won't get rid of the drop shadow effect in that image I posted, because that image is from a progressive frame, and IVTC will identify and preserve these progressive frames through its field matching process.

I think you may be describing combing, which looks like this if the video is displayed raw without any IVTC or deinterlacing at all:

https://i2.lensdump.com/i/TtDhfD.png

So the Universal DVD release is out of print.  I've tried buying it from 2 sellers who just cancel the order a few days later because it's not actually in the warehouse anymore.  I've emailed the publisher (Via Vision) who say they won't be printing any more in future.   I don't want to "download" it for various reasons, one of which is image quality.

Can anyone help?  I only want the original discs.  I do not want someone else's transcode.  I want the original MPEG2 stream that is on the disc, untouched, unaltered, 720x480i29.97.   Then I can do my own realtime IVTC with my own optimal IVTC settings in an Avisynth script.   At some point I may do a script for each episode to optimally preserve the 60i elements such as some of the animations found in the intro and some other random scenes which use different frame rates so they all go nicely into a 60p container without transcoding.

Have bought the Mill Creek release & found the image quality subpar - desaturated colours, zoomed in slightly, and this weird double-line drop shadow type effect on fine details:

https://i3.lensdump.com/i/TtotpC.png

Have previewed a transcode of the Universal release and it doesn't have these artefacts on the same episode.  These are not deinterlacing artefacts by the way, nor are they frame blending artefacts - image was captured from a static progressive frame.  If I had to guess I'd say it's probably some primitive deflicker filter to reduce interlace flicker on CRTs that got baked into the source at some point in the chain, and then further janked up by a weird scaling algorithm used by ancient analogue equipment.