Dolby Vision now possible through MP4 Mux.

Please post here for issues related to UHD discs
shawnc22
Posts: 637
Joined: Tue Jan 21, 2020 7:40 am

Re: Dolby Vision now possible through MP4 Mux.

Post by shawnc22 »

mulucy wrote:
Wed Jul 21, 2021 5:02 pm
liamtoh1 wrote:
Wed Jul 21, 2021 4:00 pm
mulucy wrote:
Wed Jul 21, 2021 3:10 pm
Are you guys aware someone from BHD ( and some other trackers ) came up with a script to use the online WEB-DL DV layer and combine it with a UHD disk HDR10 layer? Like the movies from Disney Plus. It's DV with streaming, but HDR10 with the UHD disks. As I am typing this, I am trying to get my hands on the script. Will share it once I have it.
Interesting. Looing forward to this, especially, if can be combined with ripped MKV HDR10 titles
There is already Marvel Endgame 2019 remux available in P8 and HDR10 compatible. It works with most devices like Fire TV, Shield and etc. The DV RPU was extracted from Disney Plus and it was later combined with the HDR10 later from UHD Disk. I am working on getting the script. Wish me luck!
edit:
I was pointed here - https://github.com/quietvoid/dovi_tool
Looks like that's quietvoid's tool. Nice work @quietvoid!
quietvoid
Posts: 377
Joined: Sun Apr 19, 2020 4:15 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by quietvoid »

FWIW the profile conversion has been available for a couple months.
I just recently added ways to manipulate the metadata enough to be able to get it usable for different video (different length, letterbox bars, etc.)

The profile 5 to 8 is still very much experimental, and I'm not even sure if there's an advantage in using it when real profile 5 video is available.
Profile 5 colorspace is also significantly better for compression, so it might still look better than "hybrid" HDR10 file, picture quality wise.

Everything is based on Dolby's sample streams, which are the same content available in both profiles.
The code basically only leaves trim passes and analysed min/max/avg brightness parts of the metadata untouched (so all the metadata blocks).
The coefficients are changed to match profile 7/8.

So far there has not been any objective comparison between original profile 5 and converted profile 8.
If anyone finds something weird, I'm always open to suggestions on Github.
shawnc22
Posts: 637
Joined: Tue Jan 21, 2020 7:40 am

Re: Dolby Vision now possible through MP4 Mux.

Post by shawnc22 »

quietvoid wrote:
Wed Jul 21, 2021 8:16 pm
So far there has not been any objective comparison between original profile 5 and converted profile 8.
Sounds like a challenge for @RESET_9999 and @Mannix if they're still around! The bitrate upgrade in the hybrid may be worth the trouble if the comparisons look relatively similar in terms of brightness levels
mulucy
Posts: 145
Joined: Tue Jan 07, 2020 7:08 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by mulucy »

quietvoid wrote:
Wed Jul 21, 2021 8:16 pm
FWIW the profile conversion has been available for a couple months.
I just recently added ways to manipulate the metadata enough to be able to get it usable for different video (different length, letterbox bars, etc.)

The profile 5 to 8 is still very much experimental, and I'm not even sure if there's an advantage in using it when real profile 5 video is available.
Profile 5 colorspace is also significantly better for compression, so it might still look better than "hybrid" HDR10 file, picture quality wise.

Everything is based on Dolby's sample streams, which are the same content available in both profiles.
The code basically only leaves trim passes and analysed min/max/avg brightness parts of the metadata untouched (so all the metadata blocks).
The coefficients are changed to match profile 7/8.

So far there has not been any objective comparison between original profile 5 and converted profile 8.
If anyone finds something weird, I'm always open to suggestions on Github.
So there is this file Marvel Endgame with Dolby Vision from UHD disk. The disk only contains the HDR10 track. My understanding someone at BHD extracted the WEB-Dl with P5 RPU and merged it with the HDR10 track from the UHD disk. The final video is P8 with HDR10 layer. So, this is not a conversion from P5 >> P8, correct? And there is another video with Black Widow with P8 and HDR10 fallback on BHD. Again, someone took the WEB-Dl P5 and converted it to P8. This approach kind of makes sense based on what you are saying above since the method it's still experimental. I am very confused lol.
mulucy
Posts: 145
Joined: Tue Jan 07, 2020 7:08 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by mulucy »

shawnc22 wrote:
Wed Jul 21, 2021 9:16 pm
quietvoid wrote:
Wed Jul 21, 2021 8:16 pm
So far there has not been any objective comparison between original profile 5 and converted profile 8.
Sounds like a challenge for @RESET_9999 and @Mannix if they're still around! The bitrate upgrade in the hybrid may be worth the trouble if the comparisons look relatively similar in terms of brightness levels
Well said, we definitely need @RESET_9999 and @Mannix to make some expert comparisons
RESET_9999
Posts: 2409
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

shawnc22 wrote:
Wed Jul 21, 2021 9:16 pm
quietvoid wrote:
Wed Jul 21, 2021 8:16 pm
So far there has not been any objective comparison between original profile 5 and converted profile 8.
Sounds like a challenge for @RESET_9999 and @Mannix if they're still around! The bitrate upgrade in the hybrid may be worth the trouble if the comparisons look relatively similar in terms of brightness levels
I've been quiet but I'm still reading this thread. :)
I agree with you , the bitrate upgrade totally worth it if the conversion is properly done and from a quick test session, I don't see any difference between the original P5 and the converted P8 file.
I even muxed two different video sources: this is LOKI from Hotstar India 22mb/s profile 5 rpu converted to profile 8 and then injected to the Disney+ 16mb/s HDR10 release(which I added 72 frames to match the DV version frames count).

camera comparison: https://screenshotcomparison.com/comparison/16021



Code: Select all

Video
ID                                       : 4117 (0x1015)
Menu ID                                  : 1 (0x1)
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5.1@High
HDR format                               : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible
Codec ID                                 : 36
Duration                                 : 50 min 22 s
Bit rate                                 : 15.4 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 24.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.077
Stream size                              : 5.41 GiB (89%)
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : BT.2020
Mastering display luminance              : min: 0.0000 cd/m2, max: 1000 cd/m2
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
quietvoid
Posts: 377
Joined: Sun Apr 19, 2020 4:15 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by quietvoid »

mulucy wrote:
Wed Jul 21, 2021 11:21 pm
So there is this file Marvel Endgame with Dolby Vision from UHD disk. The disk only contains the HDR10 track. My understanding someone at BHD extracted the WEB-Dl with P5 RPU and merged it with the HDR10 track from the UHD disk. The final video is P8 with HDR10 layer. So, this is not a conversion from P5 >> P8, correct? And there is another video with Black Widow with P8 and HDR10 fallback on BHD. Again, someone took the WEB-Dl P5 and converted it to P8. This approach kind of makes sense based on what you are saying above since the method it's still experimental. I am very confused lol.
They are both profile 5 to profile 8 conversions, because the metadata source is profile 5.

RESET_9999 wrote:
Wed Jul 21, 2021 11:26 pm
I've been quiet but I'm still reading this thread. :)
I agree with you , the bitrate upgrade totally worth it if the conversion is properly done and from a quick test session, I don't see any difference between the original P5 and the converted P8 file.
I even muxed two different video sources: this is LOKI from Hotstar India 22mb/s profile 5 rpu converted to profile 8 and then injected to the Disney+ 16mb/s HDR10 release(which I added 72 frames to match the DV version frames count).

camera comparison: https://screenshotcomparison.com/comparison/16021
Very cool, thank you for the comparison.
shawnc22
Posts: 637
Joined: Tue Jan 21, 2020 7:40 am

Re: Dolby Vision now possible through MP4 Mux.

Post by shawnc22 »

RESET_9999 wrote:
Wed Jul 21, 2021 11:26 pm
I've been quiet but I'm still reading this thread. :)
I agree with you , the bitrate upgrade totally worth it if the conversion is properly done and from a quick test session, I don't see any difference between the original P5 and the converted P8 file.
I even muxed two different video sources: this is LOKI from Hotstar India 22mb/s profile 5 rpu converted to profile 8 and then injected to the Disney+ 16mb/s HDR10 release(which I added 72 frames to match the DV version frames count).

camera comparison: https://screenshotcomparison.com/comparison/16021
Would this be somewhat of an expected result? My thinking is that both the Hotstar and Disney+ releases are probably from the same master, just that one is offered at a higher bitrate. Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films and applying it to the corresponding UHD disk HDR10 layers. This will probably lead to some varied results, though, as I'm guessing whether or not a disc release and its digital counterpart are from the same master will be different from film to film.
RESET_9999
Posts: 2409
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

shawnc22 wrote:
Thu Jul 22, 2021 12:12 am
Would this be somewhat of an expected result? My thinking is that both the Hotstar and Disney+ releases are probably from the same master, just that one is offered at a higher bitrate. Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films and applying it to the corresponding UHD disk HDR10 layers. This will probably lead to some varied results, though, as I'm guessing whether or not a disc release and its digital counterpart are from the same master will be different from film to film.
Yep, I think for this to work properly, both have to come from the same HDR grade. I've compared a lot of web streaming encodes with the corresponding bluray disc and I would say it's 99% the same grade but sometimes it is different(can even be different from one streaming site to another). It would be interesting to see what happens when it's the case but personally, I don't think I would bother adding DV metadata to an HDR10 BL if it's not exactly the same grade with exactly the same metadata.

Sometimes, it's exactly the same grade (well when tonemapped to SDR) but the metadata are different, and because my TV use maxcll/fall for the tonemaping, the HDR output looks different but still looks the same tonemapped in SDR with madvr. It would be interesting to find out what would happen there as well.

I did compare Star Wars HDR10 disc vs the web HDR10 and if I recall correctly it was the same HDR grade. I assume the HDR10 encode is always made from the DV grade(even when DV not present on bluray). Seems like a waste of time and money to grade it two times. Anyway, when I get a chance, I will try to add DV rpu to this movie and then take a look if I can spot a difference

The version of Avengers Endgame that's available on torrent websites is 25fps if I'm not mistaken (bluray is 23.976). I wonder if it can affect the output too.
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
mulucy
Posts: 145
Joined: Tue Jan 07, 2020 7:08 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by mulucy »

RESET_9999 wrote:
Thu Jul 22, 2021 12:40 am
shawnc22 wrote:
Thu Jul 22, 2021 12:12 am
Would this be somewhat of an expected result? My thinking is that both the Hotstar and Disney+ releases are probably from the same master, just that one is offered at a higher bitrate. Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films and applying it to the corresponding UHD disk HDR10 layers. This will probably lead to some varied results, though, as I'm guessing whether or not a disc release and its digital counterpart are from the same master will be different from film to film.
Yep, I think for this to work properly, both have to come from the same HDR grade. I've compared a lot of web streaming encodes with the corresponding bluray disc and I would say it's 99% the same grade but sometimes it is different(can even be different from one streaming site to another). It would be interesting to see what happens when it's the case but personally, I don't think I would bother adding DV metadata to an HDR10 BL if it's not exactly the same grade with exactly the same metadata.

Sometimes, it's exactly the same grade (well when tonemapped to SDR) but the metadata are different, and because my TV use maxcll/fall for the tonemaping, the HDR output looks different but still looks the same tonemapped in SDR with madvr. It would be interesting to find out what would happen there as well.

I did compare Star Wars HDR10 disc vs the web HDR10 and if I recall correctly it was the same HDR grade. I assume the HDR10 encode is always made from the DV grade(even when DV not present on bluray). Seems like a waste of time and money to grade it two times. Anyway, when I get a chance, I will try to add DV rpu to this movie and then take a look if I can spot a difference

The version of Avengers Endgame that's available on torrent websites is 25fps if I'm not mistaken (bluray is 23.976). I wonder if it can affect the output too.
It's 23.976 actually, just checked the mediainfo
mulucy
Posts: 145
Joined: Tue Jan 07, 2020 7:08 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by mulucy »

I am not sure what the deal is. But my Apple TV 4K ( the previous Gen ) plays P7 MEL and P8 with Plex. What's interesting is, Plex plays P5 files with messed-up green or purple colors lol. Infuse Pro falls back to HDR10 with all profiles, but P5. Anybody knows what's happening, is it Plex magic or has Apple added more support via software update?
RESET_9999
Posts: 2409
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

shawnc22 wrote:
Thu Jul 22, 2021 12:12 am
Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films
I just did myself a DV version of the Star Wars New Hope UHD bluray and it looks great!! Very noticeable upgrade in quality(even on the camera comparison) and the luminance /color looks the same as the original profile 5.
https://screenshotcomparison.com/comparison/16048

for those who want to do the same, you have to remove 39 frames from the beginning and add 39 frames at the end. Then the lossless Atmos needs a negative 1627MS delay.
It plays flawlessly on the x700, the shield, and the C8 internal app. I only watched a couple of minutes though but I plan to watch the whole movie this weekend.
The first scene with all the bright white walls is great to expose the shield red push as well, I noticed it right away. The original P5 is clean.

amazing work @Quietvoid

Code: Select all

Video
ID                                       : 4117 (0x1015)
Menu ID                                  : 1 (0x1)
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5.1@High
HDR format                               : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible
Codec ID                                 : 36
Duration                                 : 2 h 4 min
Bit rate                                 : 51.3 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.258
Stream size                              : 44.6 GiB (91%)
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : BT.2020
Mastering display luminance              : min: 0.0001 cd/m2, max: 1000 cd/m2

Audio #1
ID                                       : 4352 (0x1100)
Menu ID                                  : 1 (0x1)
Format                                   : MLP FBA AC-3 16-ch
Format/Info                              : Meridian Lossless Packing FBA with 16-channel presentation
Commercial name                          : Dolby TrueHD with Dolby Atmos
Muxing mode                              : Stream extension
Codec ID                                 : 131
Duration                                 : 2 h 4 min
Bit rate mode                            : Variable
Bit rate                                 : 640 kb/s
Maximum bit rate                         : 3 705 kb/s
Channel(s)                               : 8 channels
Channel layout                           : L R C LFE Ls Rs Lb Rb
Sampling rate                            : 48.0 kHz
Frame rate                               : 31.250 FPS (1536 SPF)
Compression mode                         : Lossless
Stream size                              : 571 MiB (1%)
Language                                 : English
Service kind                             : Complete Main
Number of dynamic objects                : 13
Bed channel count                        : 1 channel
Bed channel configuration                : LFE
Last edited by RESET_9999 on Fri Jul 23, 2021 2:17 am, edited 1 time in total.
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
mulucy
Posts: 145
Joined: Tue Jan 07, 2020 7:08 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by mulucy »

RESET_9999 wrote:
Fri Jul 23, 2021 2:14 am
shawnc22 wrote:
Thu Jul 22, 2021 12:12 am
Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films
I just did myself a DV version of the Star Wars New Hope UHD bluray and it looks great!! Very noticeable upgrade in quality(even on the camera comparison) and the luminance /color looks the same as the original profile 5.
https://screenshotcomparison.com/comparison/16048

for those who want to do the same, you have to remove 39 frames from the beginning and add 39 frames at the end. Then the lossless Atmos needs a negative 1627MS delay.
It plays flawlessly on the x700, the shield, and the C8 internal app. I only watched a couple of minutes though but I plan to watch the whole movie this weekend.
The first scene with all the bright white walls is great to expose the shield red push as well, I noticed it right away. The original P5 is clean.

amazing work @Quietvoid
Thank you! I read the manual for the tool, but I am confused. Would you mind writing very short examples of combining P5 RPU with HDR10 UHD Disk in the form of script, please?

edit:
Seeing this development makes me so much happier. It's the biggest blow in Disney's face for omitting DV from UHD disks. Fking greedy aholes! Thank you, @Quietvoid!
Last edited by mulucy on Fri Jul 23, 2021 2:25 am, edited 1 time in total.
RESET_9999
Posts: 2409
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

mulucy wrote:
Fri Jul 23, 2021 2:17 am

Thank you! I read the manual for the tool, but I am confused. Would you mind writing very short examples of combining P5 RPU with HDR10 UHD Disk in the form of script, please?
sorry I'm really not the best at explaining things but the cmd-line I used are:

convert p5 to p8:

Code: Select all

dovi_tool.exe -m 3 extract-rpu X:\DV.hevc
inject p8 into HDR10 BL:

Code: Select all

dovi_tool.exe inject-rpu -i X:\HDR10.hevc --rpu_in X:\RPU.bin
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
mulucy
Posts: 145
Joined: Tue Jan 07, 2020 7:08 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by mulucy »

RESET_9999 wrote:
Fri Jul 23, 2021 2:24 am
mulucy wrote:
Fri Jul 23, 2021 2:17 am

Thank you! I read the manual for the tool, but I am confused. Would you mind writing very short examples of combining P5 RPU with HDR10 UHD Disk in the form of script, please?
sorry I'm really not the best at explaining things but the cmd-line I used are:

convert p5 to p8:

Code: Select all

dovi_tool.exe -m 3 extract-rpu X:\DV.hevc
inject p8 into HDR10 BL:

Code: Select all

dovi_tool.exe inject-rpu -i X:\HDR10.hevc --rpu_in X:\RPU.bin
This explains a lot. Thank you! Another question as X700 owner, what container did you choose for your converted Star Wars movie? AFAIK, X700 does not support MKV. And for creating a container, did you use TSmuxer or another MKV tool? I noticed you mentioned skipping and adding 39 frames, plus delaying the ATMOS track.
Last edited by mulucy on Fri Jul 23, 2021 2:29 am, edited 1 time in total.
Post Reply