Looks like that's quietvoid's tool. Nice work @quietvoid!mulucy wrote: ↑Wed Jul 21, 2021 5:02 pmThere is already Marvel Endgame 2019 remux available in P8 and HDR10 compatible. It works with most devices like Fire TV, Shield and etc. The DV RPU was extracted from Disney Plus and it was later combined with the HDR10 later from UHD Disk. I am working on getting the script. Wish me luck!liamtoh1 wrote: ↑Wed Jul 21, 2021 4:00 pmInteresting. Looing forward to this, especially, if can be combined with ripped MKV HDR10 titlesmulucy wrote: ↑Wed Jul 21, 2021 3:10 pmAre you guys aware someone from BHD ( and some other trackers ) came up with a script to use the online WEB-DL DV layer and combine it with a UHD disk HDR10 layer? Like the movies from Disney Plus. It's DV with streaming, but HDR10 with the UHD disks. As I am typing this, I am trying to get my hands on the script. Will share it once I have it.
edit:
I was pointed here - https://github.com/quietvoid/dovi_tool
Dolby Vision now possible through MP4 Mux.
Re: Dolby Vision now possible through MP4 Mux.
Re: Dolby Vision now possible through MP4 Mux.
FWIW the profile conversion has been available for a couple months.
I just recently added ways to manipulate the metadata enough to be able to get it usable for different video (different length, letterbox bars, etc.)
The profile 5 to 8 is still very much experimental, and I'm not even sure if there's an advantage in using it when real profile 5 video is available.
Profile 5 colorspace is also significantly better for compression, so it might still look better than "hybrid" HDR10 file, picture quality wise.
Everything is based on Dolby's sample streams, which are the same content available in both profiles.
The code basically only leaves trim passes and analysed min/max/avg brightness parts of the metadata untouched (so all the metadata blocks).
The coefficients are changed to match profile 7/8.
So far there has not been any objective comparison between original profile 5 and converted profile 8.
If anyone finds something weird, I'm always open to suggestions on Github.
I just recently added ways to manipulate the metadata enough to be able to get it usable for different video (different length, letterbox bars, etc.)
The profile 5 to 8 is still very much experimental, and I'm not even sure if there's an advantage in using it when real profile 5 video is available.
Profile 5 colorspace is also significantly better for compression, so it might still look better than "hybrid" HDR10 file, picture quality wise.
Everything is based on Dolby's sample streams, which are the same content available in both profiles.
The code basically only leaves trim passes and analysed min/max/avg brightness parts of the metadata untouched (so all the metadata blocks).
The coefficients are changed to match profile 7/8.
So far there has not been any objective comparison between original profile 5 and converted profile 8.
If anyone finds something weird, I'm always open to suggestions on Github.
Re: Dolby Vision now possible through MP4 Mux.
Sounds like a challenge for @RESET_9999 and @Mannix if they're still around! The bitrate upgrade in the hybrid may be worth the trouble if the comparisons look relatively similar in terms of brightness levels
Re: Dolby Vision now possible through MP4 Mux.
So there is this file Marvel Endgame with Dolby Vision from UHD disk. The disk only contains the HDR10 track. My understanding someone at BHD extracted the WEB-Dl with P5 RPU and merged it with the HDR10 track from the UHD disk. The final video is P8 with HDR10 layer. So, this is not a conversion from P5 >> P8, correct? And there is another video with Black Widow with P8 and HDR10 fallback on BHD. Again, someone took the WEB-Dl P5 and converted it to P8. This approach kind of makes sense based on what you are saying above since the method it's still experimental. I am very confused lol.quietvoid wrote: ↑Wed Jul 21, 2021 8:16 pmFWIW the profile conversion has been available for a couple months.
I just recently added ways to manipulate the metadata enough to be able to get it usable for different video (different length, letterbox bars, etc.)
The profile 5 to 8 is still very much experimental, and I'm not even sure if there's an advantage in using it when real profile 5 video is available.
Profile 5 colorspace is also significantly better for compression, so it might still look better than "hybrid" HDR10 file, picture quality wise.
Everything is based on Dolby's sample streams, which are the same content available in both profiles.
The code basically only leaves trim passes and analysed min/max/avg brightness parts of the metadata untouched (so all the metadata blocks).
The coefficients are changed to match profile 7/8.
So far there has not been any objective comparison between original profile 5 and converted profile 8.
If anyone finds something weird, I'm always open to suggestions on Github.
Re: Dolby Vision now possible through MP4 Mux.
Well said, we definitely need @RESET_9999 and @Mannix to make some expert comparisons
-
RESET_9999
- Posts: 2409
- Joined: Mon Aug 05, 2019 7:12 pm
Re: Dolby Vision now possible through MP4 Mux.
I've been quiet but I'm still reading this thread.
I agree with you , the bitrate upgrade totally worth it if the conversion is properly done and from a quick test session, I don't see any difference between the original P5 and the converted P8 file.
I even muxed two different video sources: this is LOKI from Hotstar India 22mb/s profile 5 rpu converted to profile 8 and then injected to the Disney+ 16mb/s HDR10 release(which I added 72 frames to match the DV version frames count).
camera comparison: https://screenshotcomparison.com/comparison/16021
Code: Select all
Video
ID : 4117 (0x1015)
Menu ID : 1 (0x1)
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5.1@High
HDR format : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible
Codec ID : 36
Duration : 50 min 22 s
Bit rate : 15.4 Mb/s
Width : 3 840 pixels
Height : 2 160 pixels
Display aspect ratio : 16:9
Frame rate : 24.000 FPS
Color space : YUV
Chroma subsampling : 4:2:0 (Type 2)
Bit depth : 10 bits
Bits/(Pixel*Frame) : 0.077
Stream size : 5.41 GiB (89%)
Color range : Limited
Color primaries : BT.2020
Transfer characteristics : PQ
Matrix coefficients : BT.2020 non-constant
Mastering display color primaries : BT.2020
Mastering display luminance : min: 0.0000 cd/m2, max: 1000 cd/m2Re: Dolby Vision now possible through MP4 Mux.
They are both profile 5 to profile 8 conversions, because the metadata source is profile 5.mulucy wrote: ↑Wed Jul 21, 2021 11:21 pmSo there is this file Marvel Endgame with Dolby Vision from UHD disk. The disk only contains the HDR10 track. My understanding someone at BHD extracted the WEB-Dl with P5 RPU and merged it with the HDR10 track from the UHD disk. The final video is P8 with HDR10 layer. So, this is not a conversion from P5 >> P8, correct? And there is another video with Black Widow with P8 and HDR10 fallback on BHD. Again, someone took the WEB-Dl P5 and converted it to P8. This approach kind of makes sense based on what you are saying above since the method it's still experimental. I am very confused lol.
Very cool, thank you for the comparison.RESET_9999 wrote: ↑Wed Jul 21, 2021 11:26 pmI've been quiet but I'm still reading this thread.
I agree with you , the bitrate upgrade totally worth it if the conversion is properly done and from a quick test session, I don't see any difference between the original P5 and the converted P8 file.
I even muxed two different video sources: this is LOKI from Hotstar India 22mb/s profile 5 rpu converted to profile 8 and then injected to the Disney+ 16mb/s HDR10 release(which I added 72 frames to match the DV version frames count).
camera comparison: https://screenshotcomparison.com/comparison/16021
Re: Dolby Vision now possible through MP4 Mux.
Would this be somewhat of an expected result? My thinking is that both the Hotstar and Disney+ releases are probably from the same master, just that one is offered at a higher bitrate. Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films and applying it to the corresponding UHD disk HDR10 layers. This will probably lead to some varied results, though, as I'm guessing whether or not a disc release and its digital counterpart are from the same master will be different from film to film.RESET_9999 wrote: ↑Wed Jul 21, 2021 11:26 pmI've been quiet but I'm still reading this thread.
I agree with you , the bitrate upgrade totally worth it if the conversion is properly done and from a quick test session, I don't see any difference between the original P5 and the converted P8 file.
I even muxed two different video sources: this is LOKI from Hotstar India 22mb/s profile 5 rpu converted to profile 8 and then injected to the Disney+ 16mb/s HDR10 release(which I added 72 frames to match the DV version frames count).
camera comparison: https://screenshotcomparison.com/comparison/16021
-
RESET_9999
- Posts: 2409
- Joined: Mon Aug 05, 2019 7:12 pm
Re: Dolby Vision now possible through MP4 Mux.
Yep, I think for this to work properly, both have to come from the same HDR grade. I've compared a lot of web streaming encodes with the corresponding bluray disc and I would say it's 99% the same grade but sometimes it is different(can even be different from one streaming site to another). It would be interesting to see what happens when it's the case but personally, I don't think I would bother adding DV metadata to an HDR10 BL if it's not exactly the same grade with exactly the same metadata.shawnc22 wrote: ↑Thu Jul 22, 2021 12:12 amWould this be somewhat of an expected result? My thinking is that both the Hotstar and Disney+ releases are probably from the same master, just that one is offered at a higher bitrate. Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films and applying it to the corresponding UHD disk HDR10 layers. This will probably lead to some varied results, though, as I'm guessing whether or not a disc release and its digital counterpart are from the same master will be different from film to film.
Sometimes, it's exactly the same grade (well when tonemapped to SDR) but the metadata are different, and because my TV use maxcll/fall for the tonemaping, the HDR output looks different but still looks the same tonemapped in SDR with madvr. It would be interesting to find out what would happen there as well.
I did compare Star Wars HDR10 disc vs the web HDR10 and if I recall correctly it was the same HDR grade. I assume the HDR10 encode is always made from the DV grade(even when DV not present on bluray). Seems like a waste of time and money to grade it two times. Anyway, when I get a chance, I will try to add DV rpu to this movie and then take a look if I can spot a difference
The version of Avengers Endgame that's available on torrent websites is 25fps if I'm not mistaken (bluray is 23.976). I wonder if it can affect the output too.
Re: Dolby Vision now possible through MP4 Mux.
It's 23.976 actually, just checked the mediainfoRESET_9999 wrote: ↑Thu Jul 22, 2021 12:40 amYep, I think for this to work properly, both have to come from the same HDR grade. I've compared a lot of web streaming encodes with the corresponding bluray disc and I would say it's 99% the same grade but sometimes it is different(can even be different from one streaming site to another). It would be interesting to see what happens when it's the case but personally, I don't think I would bother adding DV metadata to an HDR10 BL if it's not exactly the same grade with exactly the same metadata.shawnc22 wrote: ↑Thu Jul 22, 2021 12:12 amWould this be somewhat of an expected result? My thinking is that both the Hotstar and Disney+ releases are probably from the same master, just that one is offered at a higher bitrate. Maybe a better comparison would be taking the profile 5 RPU from one of the Disney+ Marvel or Star Wars films and applying it to the corresponding UHD disk HDR10 layers. This will probably lead to some varied results, though, as I'm guessing whether or not a disc release and its digital counterpart are from the same master will be different from film to film.
Sometimes, it's exactly the same grade (well when tonemapped to SDR) but the metadata are different, and because my TV use maxcll/fall for the tonemaping, the HDR output looks different but still looks the same tonemapped in SDR with madvr. It would be interesting to find out what would happen there as well.
I did compare Star Wars HDR10 disc vs the web HDR10 and if I recall correctly it was the same HDR grade. I assume the HDR10 encode is always made from the DV grade(even when DV not present on bluray). Seems like a waste of time and money to grade it two times. Anyway, when I get a chance, I will try to add DV rpu to this movie and then take a look if I can spot a difference
The version of Avengers Endgame that's available on torrent websites is 25fps if I'm not mistaken (bluray is 23.976). I wonder if it can affect the output too.
Re: Dolby Vision now possible through MP4 Mux.
I am not sure what the deal is. But my Apple TV 4K ( the previous Gen ) plays P7 MEL and P8 with Plex. What's interesting is, Plex plays P5 files with messed-up green or purple colors lol. Infuse Pro falls back to HDR10 with all profiles, but P5. Anybody knows what's happening, is it Plex magic or has Apple added more support via software update?
-
RESET_9999
- Posts: 2409
- Joined: Mon Aug 05, 2019 7:12 pm
Re: Dolby Vision now possible through MP4 Mux.
I just did myself a DV version of the Star Wars New Hope UHD bluray and it looks great!! Very noticeable upgrade in quality(even on the camera comparison) and the luminance /color looks the same as the original profile 5.
https://screenshotcomparison.com/comparison/16048
for those who want to do the same, you have to remove 39 frames from the beginning and add 39 frames at the end. Then the lossless Atmos needs a negative 1627MS delay.
It plays flawlessly on the x700, the shield, and the C8 internal app. I only watched a couple of minutes though but I plan to watch the whole movie this weekend.
The first scene with all the bright white walls is great to expose the shield red push as well, I noticed it right away. The original P5 is clean.
amazing work @Quietvoid
Code: Select all
Video
ID : 4117 (0x1015)
Menu ID : 1 (0x1)
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L5.1@High
HDR format : Dolby Vision, Version 1.0, dvhe.08.06, BL+RPU, HDR10 compatible / SMPTE ST 2086, HDR10 compatible
Codec ID : 36
Duration : 2 h 4 min
Bit rate : 51.3 Mb/s
Width : 3 840 pixels
Height : 2 160 pixels
Display aspect ratio : 16:9
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0 (Type 2)
Bit depth : 10 bits
Bits/(Pixel*Frame) : 0.258
Stream size : 44.6 GiB (91%)
Color range : Limited
Color primaries : BT.2020
Transfer characteristics : PQ
Matrix coefficients : BT.2020 non-constant
Mastering display color primaries : BT.2020
Mastering display luminance : min: 0.0001 cd/m2, max: 1000 cd/m2
Audio #1
ID : 4352 (0x1100)
Menu ID : 1 (0x1)
Format : MLP FBA AC-3 16-ch
Format/Info : Meridian Lossless Packing FBA with 16-channel presentation
Commercial name : Dolby TrueHD with Dolby Atmos
Muxing mode : Stream extension
Codec ID : 131
Duration : 2 h 4 min
Bit rate mode : Variable
Bit rate : 640 kb/s
Maximum bit rate : 3 705 kb/s
Channel(s) : 8 channels
Channel layout : L R C LFE Ls Rs Lb Rb
Sampling rate : 48.0 kHz
Frame rate : 31.250 FPS (1536 SPF)
Compression mode : Lossless
Stream size : 571 MiB (1%)
Language : English
Service kind : Complete Main
Number of dynamic objects : 13
Bed channel count : 1 channel
Bed channel configuration : LFE
Last edited by RESET_9999 on Fri Jul 23, 2021 2:17 am, edited 1 time in total.
Re: Dolby Vision now possible through MP4 Mux.
Thank you! I read the manual for the tool, but I am confused. Would you mind writing very short examples of combining P5 RPU with HDR10 UHD Disk in the form of script, please?RESET_9999 wrote: ↑Fri Jul 23, 2021 2:14 amI just did myself a DV version of the Star Wars New Hope UHD bluray and it looks great!! Very noticeable upgrade in quality(even on the camera comparison) and the luminance /color looks the same as the original profile 5.
https://screenshotcomparison.com/comparison/16048
for those who want to do the same, you have to remove 39 frames from the beginning and add 39 frames at the end. Then the lossless Atmos needs a negative 1627MS delay.
It plays flawlessly on the x700, the shield, and the C8 internal app. I only watched a couple of minutes though but I plan to watch the whole movie this weekend.
The first scene with all the bright white walls is great to expose the shield red push as well, I noticed it right away. The original P5 is clean.
amazing work @Quietvoid
edit:
Seeing this development makes me so much happier. It's the biggest blow in Disney's face for omitting DV from UHD disks. Fking greedy aholes! Thank you, @Quietvoid!
Last edited by mulucy on Fri Jul 23, 2021 2:25 am, edited 1 time in total.
-
RESET_9999
- Posts: 2409
- Joined: Mon Aug 05, 2019 7:12 pm
Re: Dolby Vision now possible through MP4 Mux.
sorry I'm really not the best at explaining things but the cmd-line I used are:
convert p5 to p8:
Code: Select all
dovi_tool.exe -m 3 extract-rpu X:\DV.hevcCode: Select all
dovi_tool.exe inject-rpu -i X:\HDR10.hevc --rpu_in X:\RPU.binRe: Dolby Vision now possible through MP4 Mux.
This explains a lot. Thank you! Another question as X700 owner, what container did you choose for your converted Star Wars movie? AFAIK, X700 does not support MKV. And for creating a container, did you use TSmuxer or another MKV tool? I noticed you mentioned skipping and adding 39 frames, plus delaying the ATMOS track.RESET_9999 wrote: ↑Fri Jul 23, 2021 2:24 amsorry I'm really not the best at explaining things but the cmd-line I used are:
convert p5 to p8:inject p8 into HDR10 BL:Code: Select all
dovi_tool.exe -m 3 extract-rpu X:\DV.hevcCode: Select all
dovi_tool.exe inject-rpu -i X:\HDR10.hevc --rpu_in X:\RPU.bin
Last edited by mulucy on Fri Jul 23, 2021 2:29 am, edited 1 time in total.