Dolby Vision now possible through MP4 Mux.

Please post here for issues related to UHD discs
PapitaHD
Posts: 26
Joined: Sun Mar 01, 2020 10:31 am

Re: Dolby Vision now possible through MP4 Mux.

Post by PapitaHD »

yusesope wrote:
Wed Sep 23, 2020 11:25 am
At this stage I'm interested in the mp4 format (simply because we have Dolby's mp4muxer and because Dolby itself got its hands on the ExoP code for this container).
Ergo, if ExoP correctly plays the edited MEL mp4 files and if the content of these files (transposed into m2ts DTDL) is played on the Sony X700/M9702 (devices that have only one task and cannot be modded...at least not by me) then the files we're testing aren't completely weird.
I don't know if this helps but I did another test: muxed a short sample of Saving Private Ryan to single track dual layer FEL, then I demuxed and converted it to MEL (with method2 version of the tool) and transported the BL and EL+RPU hevc's with the latest tsMuxer into a dual track dual layer m2ts. It plays perfectly on my M9702 and looks the same as the original complete UHD BluRay backup.
Last edited by PapitaHD on Fri Sep 25, 2020 8:55 pm, edited 1 time in total.
chros
Posts: 102
Joined: Sun Sep 20, 2020 8:36 am

Re: Dolby Vision now possible through MP4 Mux.

Post by chros »

PapitaHD wrote:
Fri Sep 25, 2020 12:42 pm
yusesope wrote:
Wed Sep 23, 2020 11:25 am
At this stage I'm interested in the mp4 format (simply because we have Dolby's mp4muxer and because Dolby itself got its hands on the ExoP code for this container).
Ergo, if ExoP correctly plays the edited MEL mp4 files and if the content of these files (transposed into m2ts DTDL) is played on the Sony X700/M9702 (devices that have only one task and cannot be modded...at least not by me) then the files we're testing aren't completely weird.
I don't if this helps but I did another test: muxed a short sample of Saving Private Ryan to single track dual layer FEL, then I demuxed and converted it to MEL (with method2 version of the tool) and transported the BL and EL+RPU hevc's with the latest tsMuxer into a dual track dual layer m2ts. It plays perfectly on my M9702 and looks the same as the original complete UHD BluRay backup.
Can you upload it somewhere? I also like. to try it out, thanks!
PapitaHD
Posts: 26
Joined: Sun Mar 01, 2020 10:31 am

Re: Dolby Vision now possible through MP4 Mux.

Post by PapitaHD »

chros wrote:
Fri Sep 25, 2020 1:37 pm
PapitaHD wrote:
Fri Sep 25, 2020 12:42 pm
yusesope wrote:
Wed Sep 23, 2020 11:25 am
At this stage I'm interested in the mp4 format (simply because we have Dolby's mp4muxer and because Dolby itself got its hands on the ExoP code for this container).
Ergo, if ExoP correctly plays the edited MEL mp4 files and if the content of these files (transposed into m2ts DTDL) is played on the Sony X700/M9702 (devices that have only one task and cannot be modded...at least not by me) then the files we're testing aren't completely weird.
I don't if this helps but I did another test: muxed a short sample of Saving Private Ryan to single track dual layer FEL, then I demuxed and converted it to MEL (with method2 version of the tool) and transported the BL and EL+RPU hevc's with the latest tsMuxer into a dual track dual layer m2ts. It plays perfectly on my M9702 and looks the same as the original complete UHD BluRay backup.
Can you upload it somewhere? I also like. to try it out, thanks!
Here you go: https://we.tl/t-scOQyYpmT9
chros
Posts: 102
Joined: Sun Sep 20, 2020 8:36 am

Re: Dolby Vision now possible through MP4 Mux.

Post by chros »

PapitaHD wrote:
Fri Sep 25, 2020 4:58 pm
Here you go: https://we.tl/t-scOQyYpmT9
Thanks, both (m2ts and ts files) indeed work well on m9702! The interesting part is that the old Joker dvhe.07.06_BL_EL_RPU_Single_Track_Double_Layer.mp4 sample didn't work :)
lexyz
Posts: 120
Joined: Fri May 08, 2020 5:32 am

Re: Dolby Vision now possible through MP4 Mux.

Post by lexyz »

PapitaHD wrote:
Fri Sep 25, 2020 12:42 pm
I don't know if this helps but I did another test: muxed a short sample of Saving Private Ryan to single track dual layer FEL, then I demuxed and converted it to MEL (with method2 version of the tool) and transported the BL and EL+RPU hevc's with the latest tsMuxer into a dual track dual layer m2ts. It plays perfectly on my M9702 and looks the same as the original complete UHD BluRay backup.
It seems this STDL.sample doesn't flicker on shield.
Hard to tell for sure.
Can you please make one more sample but 1 min longer?
Bravia XF90, Shield TV Pro'19, UBP-X700
PapitaHD
Posts: 26
Joined: Sun Mar 01, 2020 10:31 am

Re: Dolby Vision now possible through MP4 Mux.

Post by PapitaHD »

lexyz wrote:
Sat Sep 26, 2020 6:02 am
PapitaHD wrote:
Fri Sep 25, 2020 12:42 pm
I don't know if this helps but I did another test: muxed a short sample of Saving Private Ryan to single track dual layer FEL, then I demuxed and converted it to MEL (with method2 version of the tool) and transported the BL and EL+RPU hevc's with the latest tsMuxer into a dual track dual layer m2ts. It plays perfectly on my M9702 and looks the same as the original complete UHD BluRay backup.
It seems this STDL.sample doesn't flicker on shield.
Hard to tell for sure.
Can you please make one more sample but 1 min longer?
Here is a 3 min long sample: https://we.tl/t-K5JhSURkGS
yusesope
Posts: 221
Joined: Sun Jul 28, 2019 3:34 am

Re: Dolby Vision now possible through MP4 Mux.

Post by yusesope »

RESET_9999 wrote:
Thu Sep 24, 2020 10:23 pm
yep, it looks like @yusesope fel to mel conversions are done properly.
https://screenshotcomparison.com/comparison/6581
PapitaHD wrote:
Fri Sep 25, 2020 12:42 pm
...muxed a short sample of Saving Private Ryan to single track dual layer FEL, then I demuxed and converted it to MEL ...It plays perfectly on my M9702 and looks the same as the original complete UHD BluRay backup.
Thank you for your time. Thanks to your tests it seems to me that "method 2" is safe and functional.

Before releasing version v0.0.4_BETA I need one last test: an STDL FEL-> MEL file inside the MKV container (to be tested on a device like the FireStick 4K, capable of playing MEL profile 7 but not FEL profile 7 ). Of course you have to use my version of ExoP.
Always using the various conversion steps FEL -> MEL, instead of creating an m2ts MEL DTDL in TsMuxeR, generate an ISO (always adding first BL.hevc and then EL_RPU.hevc in TsMuxeR) and feed it to MakeMKV.


ghostshadow wrote:
Thu Sep 24, 2020 3:29 pm
If I use TsMuxeR to mux 'BL_EL_RPU.hevc' which is in dv 8 profile with Dts audio tracks, TsMuxer switches me back to dv 7 profile, and it is read in HDR PQ and not in Dolby Vision.
............
I would like to have a .ts with a dv 8 profile
thanks
This behavior is normal. If you give TsMuxeR a raw hevc stream consisting of BL+EL+RPU, TsMuxer will only be able to assign profile 7.
Do you want profile 8? You have to import a stream with only BL+RPU into TsMuxeR. To do this, right click on "MUX.bat" and "MUX_AND_CONVERT_TO_MEL.bat" and then select "Edit". Add the string -mode 2 in both and save the changes. At the moment, however, I do not recommend proceeding with this solution. Read on to understand why.
PS:
the name of the file created will always be BL_EL_RPU.hevc but it is simply a placeholder for people who are "too lazy" :wink: to use the command line
Image


RESET_9999 wrote:
Thu Sep 24, 2020 10:23 pm
if you're looking for a new project, I would love an RPU parser(supported by x265.exe) just like the HDR10+ parser does so I can encode uhd-BD to true profile 5 full range. :P
mulucy wrote:
Fri Sep 25, 2020 1:20 am
True profile 5, that's what I am waiting for...
I honestly don't understand why you guys care so much about profile 5.
It uses a proprietary color space (the advantages of which will perhaps be appreciable when we have 12bit panels) and not having an Enhancement Layer is definitely lower quality than a UHD-BD. So why?

Converting a color space involves an encoding operation, and if you wait for me to write an encoder from scratch then the wait will be very long (years).
I'm sure there are people in the world who are already working on it. I don't have the skills for that!

Instead I am doing some experiments on profile 8 (in particular 8.1). The idea is to improve my -mode 2 (UHD-BD -> 8.1). This profile should work for any "streaming device" (from televisions to consoles). What do you think?
Image


ghostshadow wrote:
Thu Sep 24, 2020 5:39 pm
Good evening yusesope, how do you get the RPU out of the EL? it is to be able to encode afterwards in x265
thank you
RESET_9999 wrote:
Thu Sep 24, 2020 10:23 pm
if you're looking for a new project, I would love an RPU parser(supported by x265.exe)...
x265 does not need a parser for RPU. It simply accepts a file containing the RPUs (I presume sorted according to each access unit present in the Base Layer). Look HERE.

What's the problem? If you proceed with an encoding of the Base Layer then you must also change the parameters of the RPU. At the moment, however, we do not know the algorithm that allows to generate new RPUs!
Last edited by yusesope on Sat Sep 26, 2020 8:31 am, edited 1 time in total.
lexyz
Posts: 120
Joined: Fri May 08, 2020 5:32 am

Re: Dolby Vision now possible through MP4 Mux.

Post by lexyz »

PapitaHD wrote:
Sat Sep 26, 2020 7:14 am
Here is a 3 min long sample: https://we.tl/t-K5JhSURkGS
much appreciated :D
Still flickers
Bravia XF90, Shield TV Pro'19, UBP-X700
PapitaHD
Posts: 26
Joined: Sun Mar 01, 2020 10:31 am

Re: Dolby Vision now possible through MP4 Mux.

Post by PapitaHD »

lexyz wrote:
Sat Sep 26, 2020 8:29 am
PapitaHD wrote:
Sat Sep 26, 2020 7:14 am
Here is a 3 min long sample: https://we.tl/t-K5JhSURkGS
much appreciated :D
Still flickers
Bad news... After you'd said it's flickering I checked Saving Private Ryan again with longer samples and sadly it really flickers on C8 and M9702 too.
Final conclusion: STDL MEL (and DTDL MEL) flickers but STDL FEL doesn't.

Strange thing is that Transformers 4 (which has about the same bitrate for its FEL) works perfectly after the MEL conversion, no flickering at all.

I'm gonna test a few more titles.
ghostshadow
Posts: 55
Joined: Sun Sep 13, 2020 10:25 am

Re: Dolby Vision now possible through MP4 Mux.

Post by ghostshadow »

yusesope wrote:
Sat Sep 26, 2020 8:21 am
RESET_9999 wrote:
Thu Sep 24, 2020 10:23 pm
yep, it looks like @yusesope fel to mel conversions are done properly.
https://screenshotcomparison.com/comparison/6581

This behavior is normal. If you give TsMuxeR a raw hevc stream consisting of BL+EL+RPU, TsMuxer will only be able to assign profile 7.
Do you want profile 8? You have to import a stream with only BL+RPU into TsMuxeR. To do this, right click on "MUX.bat" and "MUX_AND_CONVERT_TO_MEL.bat" and then select "Edit". Add the string -mode 2 in both and save the changes. At the moment, however, I do not recommend proceeding with this solution. Read on to understand why.
PS:
the name of the file created will always be BL_EL_RPU.hevc but it is simply a placeholder for people who are "too lazy" :wink: to use the command line
Image


I honestly don't understand why you guys care so much about profile 5.
It uses a proprietary color space (the advantages of which will perhaps be appreciable when we have 12bit panels) and not having an Enhancement Layer is definitely lower quality than a UHD-BD. So why?

Converting a color space involves an encoding operation, and if you wait for me to write an encoder from scratch then the wait will be very long (years).
I'm sure there are people in the world who are already working on it. I don't have the skills for that!

Instead I am doing some experiments on profile 8 (in particular 8.1). The idea is to improve my -mode 2 (UHD-BD -> 8.1). This profile should work for any "streaming device" (from televisions to consoles). What do you think?
Image


x265 does not need a parser for RPU. It simply accepts a file containing the RPUs (I presume sorted according to each access unit present in the Base Layer). Look HERE.

What's the problem? If you proceed with an encoding of the Base Layer then you must also change the parameters of the RPU. At the moment, however, we do not know the algorithm that allows to generate new RPUs!
Thank you very much!
ragico
Posts: 265
Joined: Fri Feb 15, 2019 1:09 am

Re: Dolby Vision now possible through MP4 Mux.

Post by ragico »

yusesope wrote:
Sat Sep 26, 2020 8:21 am
Before releasing version v0.0.4_BETA I need one last test: an STDL FEL-> MEL file inside the MKV container (to be tested on a device like the FireStick 4K, capable of playing MEL profile 7 but not FEL profile 7 ). Of course you have to use my version of ExoP.
Always using the various conversion steps FEL -> MEL, instead of creating an m2ts MEL DTDL in TsMuxeR, generate an ISO (always adding first BL.hevc and then EL_RPU.hevc in TsMuxeR) and feed it to MakeMKV.
Tested and works in firestick.
yusesope
Posts: 221
Joined: Sun Jul 28, 2019 3:34 am

Re: Dolby Vision now possible through MP4 Mux.

Post by yusesope »

ragico wrote:
Sat Sep 26, 2020 10:22 am
Tested and works in firestick.
Thanks for your invaluable help!

lexyz wrote:
Sat Sep 26, 2020 8:29 am
Still flickers
PapitaHD wrote:
Sat Sep 26, 2020 9:35 am
Bad news... After you'd said it's flickering I checked Saving Private Ryan again with longer samples and sadly it really flickers on C8 and M9702 too.
Final conclusion: STDL MEL (and DTDL MEL) flickers but STDL FEL doesn't.

Strange thing is that Transformers 4 (which has about the same bitrate for its FEL) works perfectly after the MEL conversion, no flickering at all.

I'm gonna test a few more titles.
Thanks for reporting! I hope Private Ryan is an exception. If you do any more tests, please let us know the results!

mike admin wrote:
Thu Mar 12, 2020 2:51 pm
Ciao mike!
Today @lexyz and @PapitaHD started the "bug hunting" day :lol: .
It seemed rude not to invite you to play with us :D !
Maybe (and just maybe) I ran into a MakeMKV bug.
THIS 60 sec sample comes from the Spears & Munsil UHD-BD. It is a file with DV MEL but MakeMKV does not recognize it as such and generates a DV-free mkv.
I believe your logic is based on analyzing the nonlinear quantization parameters. The problem is that these RPUs don't have any (due to the value of the boolean disable_residual_flag). You should add a safety net for this non-standard file type.
iamTa
Posts: 13
Joined: Sat Sep 19, 2020 10:13 am

Re: Dolby Vision now possible through MP4 Mux.

Post by iamTa »

yusesope wrote:Before releasing version v0.0.4_BETA I need one last test: an STDL FEL-> MEL file inside the MKV container (to be tested on a device like the FireStick 4K, capable of playing MEL profile 7 but not FEL profile 7 ). Of course you have to use my version of ExoP.
Always using the various conversion steps FEL -> MEL, instead of creating an m2ts MEL DTDL in TsMuxeR, generate an ISO (always adding first BL.hevc and then EL_RPU.hevc in TsMuxeR) and feed it to MakeMKV.
I've just tested this and it works perfectly on an Nvidia Shield!
PapitaHD
Posts: 26
Joined: Sun Mar 01, 2020 10:31 am

Re: Dolby Vision now possible through MP4 Mux.

Post by PapitaHD »

I've created a few mkv's with the method yusesope described (converting to MEL with method2, creating ISO with tsMuxeR then remux it with MakeMKV), so others can test them, unfortunately I don't own a device which would be able to play DV-mkv.
Saving Private Ryan is among them, would be interesting to see whether it flickers in an mkv container too or not.
Gladiator & Kick-Ass: https://we.tl/t-eDu4zjnQj0
Apocalypse Now: https://we.tl/t-SJaD5a4ExL
Transformers 4: https://we.tl/t-z6Oos2hHxy
Saving Private Ryan: https://we.tl/t-IgV2cbcSuY

I checked all of them and only Saving Private Ryan flickers.
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

yusesope wrote:
Sat Sep 26, 2020 8:21 am
I honestly don't understand why you guys care so much about profile 5.
It uses a proprietary color space (the advantages of which will perhaps be appreciable when we have 12bit panels) and not having an Enhancement Layer is definitely lower quality than a UHD-BD. So why?
Because I have a another DV TV with an appleTV in another room.
yusesope wrote:
Sat Sep 26, 2020 8:21 am

Converting a color space involves an encoding operation,
I'm not sure about that, The Sony x700 , the Windows 10 Movies & TV app can tone map on the fly, profile 5 full range to HDR10 bt2020 or SDR bt709. The vertex 2 can also do that.
But i do get that in order to obtain a new/proper profile 5 file, encoding is required.
yusesope wrote:
Sat Sep 26, 2020 8:21 am
if you wait for me to write an encoder from scratch then the wait will be very long (years).
the encoder (x265.exe) already exists for that.. I was just asking for a tool that can extract the RPU information to a file that would be accepted in x265.exe
yusesope wrote:
Sat Sep 26, 2020 8:21 am

What's the problem? If you proceed with an encoding of the Base Layer then you must also change the parameters of the RPU. At the moment, however, we do not know the algorithm that allows to generate new RPUs!
it's all fine, it was a long shot. I was just hoping for more magic coming from you :)
I appreciate all the work you've done.
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
Post Reply