Dolby Vision now possible through MP4 Mux.

Please post here for issues related to UHD discs
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

dapope wrote:
Wed Aug 02, 2023 9:01 am

@RESET_9999 Do you have any idea why this might be the case? Any help would be appreciated.
I don't know...
Network issue? HDD issue? Maybe the player choked at some point because of frame-by-frame?
Also I would check if there isn't a bug in your program switching the left and right offset. I'm sure I entered the left offset as 125 and the right offset as 124, but now the metadata is saying it's reversed (like the one you posted).
Because when you set uneven L5 offsets in resolve or cm_analyze, the dovi_tool(XML to rpu) has no way to calculate exactly which position the offsets go because the XML file works with aspect ratio values only.
This is exactly the reason why the script (1-1) has an option to edit L5 with XML inputs.
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

bbeny123 wrote:
Tue Aug 01, 2023 7:15 pm
I've improved mp4muxer (official dlb_mp4base) a bit.

The main improvement is a significant boost in the performance of muxing hevc files.
In the official version, after reading the input files, the mp4muxer looks like it goes idle (low CPU usage, minimal disk usage).
During the "inactivity" the program does n * n loops (where n = number of video frames) - so the longer (not bigger) the input video, the longer the idleness period. After my fixes, such a loop is made only once (by using a map-like data structure).
This fix significantly reduces the time needed to mux hevc files, the "idle" time has been reduced to almost 0. Muxing performance now depends almost only on the speed of the used disk.

Other changes:
  • Fixed codec id for EL layer (codec id for the EL layer is again 'dvhe' and not 'hev1') - in this aspect, the behavior is the same as in the old 'mp4muxer_64bits' version (1.0.0)
  • Support for .eac3 audio input
  • Muxing progress logging
Source code, binaries, full changelog: https://github.com/bbeny123/mp4muxer
thanks, I'll try it.
Have you tested if the file works on older LG TVs ? (2018 or older)
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
FonduemangVI
Posts: 5
Joined: Tue Apr 18, 2023 12:13 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by FonduemangVI »

@RESET_9999 Hey would you be able to explain what the FraMeSToR illegal L5 change at frame 203356 for GotG Vol 3 is?/why it's illegal?
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

FonduemangVI wrote:
Wed Aug 02, 2023 1:25 pm
@RESET_9999 Hey would you be able to explain what the FraMeSToR illegal L5 change at frame 203356 for GotG Vol 3 is?/why it's illegal?
L5 can only change at the rpu scene cuts(refresh flag) and there is no scene cut at frame 203356.
You can export the rpu scene cut frames with my script (2-4)
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
bbeny123
Posts: 19
Joined: Tue Aug 01, 2023 6:33 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by bbeny123 »

RESET_9999 wrote:
Wed Aug 02, 2023 12:26 pm
Have you tested if the file works on older LG TVs ? (2018 or older)
Nope, I've tested LG C9 only.
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

interesting new options in the new dolby vision tools pack:

https://slow.pics/c/5irgGGKG
L1 Analysis Tuning:
Index Title
0 Legacy CM4 L1
1 Most Highlight Detail/Most Mapping
2 More Highlight Detail/More Mapping
3 Balanced
4 Less Highlight Detail/Less Mapping
5 Least Highlight Detail/Least Mapping
Analysis tuning provides user control over the strength of filtering used during analysis. Six options are
provided that match the options found in partner tools after updating to the 2023 New CM4 L1. As the
index increases, so does the amount of filtering, lowering the L1 max.
Stronger filters may result in clipping of fine details in the highlights while reducing the amount of
mapping. By default, cm_analyze uses the 1 – Most Highlight Detail / Most Mapping
with the intent of preserving as much highlight detail as possible, with the exception of when the --
live-infinite-filter option is invoked. In this case, the analysis defaults to 0 – Legacy CM4
L1 to match the Dolby Live Distribution Processor product
Dolby is please to announce the immediate availability of the Dolby Vision Professional Tools v5.4, available now at customer.dolby.com.

New Feature Summary in this release
New L1 analysis features in cm_analyze
Added 2023 New L1 frame statistics algorithm with user-tuneable spatial filtering, new hybrid mid measurement, unified gamut analysis, and improved black measurement.
New statistics are enabled by default, and tuning can be adjusted using --analysis-tuning <arg>
See the user manual for more information
Older frame statistics are available using --legacy-cm4-l1
Improved file-based long play analysis algorithm
New temporal smoothing algorithm
New backwards compatibility metadata for frame-by-frame analysis
New difference detection to group scenes together
Added --live-infinite-filter to match analysis done in Dolby's Live Distribution Processor
Added new stereoscopic analysis for shot based and file based / frame-by-frame analysis. Right eye view can be added using --input2 <rightEye>
Added new global looks that can be added to your analysis, using --global-trims <globalLook.xml>.
See the user manual for more information
--source-format now requires both the transfer function (pq) and color gamut (p3d65 or bt2020)
• Added new functions in metafier for handling per-shot L5:
--validate performs new checks & reports
looks for and validates per-shot L5. An error will be reported if the per-shot canvas does not match the global canvas
Examines CM 4 XMLs (v4.0.2 & v5.1.0) for "illegal" legacy L1 values.
Separate count for default Target ID 1 L8 trims
--aspect-ratios <arg1> <arg2> now updates canvas of per-shot L5 and removes
See the user manual for more information
--preserve-per-shot-active preserve the current global active aspect ratio as per-shot L5 when updating aspect ratios
--global-trims <globalLook.xml> can inject a global look by applying specified trims to all shots & frames within an existing XML
See the user manual for more information
Cm_offline improvements:
Added new 300 nits P3D65 & BT.2020 targets to cm_offline
Added flag --skip-qt-st2086-min-check to permit cm_offline to continue when a QuickTime MOV's ST.2086 minimum (mdcv) does not match the Dolby Vision master display minimum
Bug fixes in this release
Fixed minor analysis bugs from 5.4-beta-1
Fixed an issue with rejecting 4:2:0 subsampled jpeg2000 files.
Known issues
Some shell environments may require the use of quotes for each input XML file when using the command line reel frame range option

You can access the new product here:
https://customer.dolby.com/content-crea ... tools-v540
Best regards,
Dolby Laboratories, Inc.
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
EncodeThis420
Posts: 8
Joined: Wed Aug 02, 2023 6:49 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by EncodeThis420 »

Hi everyone. I am struggling to understand the below in regards to the hybrid dolby vision profile 8 format. i really hope that someone can help explain this to me:

I keep seeing encodes that take a dolby vision profile 5 stream and combine it with a hdr10 (and/or) hdr10+ stream. I see everyone saying that this helps with compatability. So if you have DV device, it’ll play DV, otherwise it’ll play HDR10/HDR10+.

I have been told that this messes up the original artistic intent of the Dolby Vision Profile 5 stream because it’s using 2 different sources with 2 different gradings. So my question is - if you have a DV device, is the DV profile 5 grading being changed at all from the original? in other words, when it plays back in DV, is it using the HDR10 base layer or is it only using the DV profile 5 info? Hope that makes sense.

I am asking because it seems like ALL of the new DV encodes I’m seeing are in this hybrid format. If it does indeed change the image from the original intent then I have no clue why all of the current encoders are using this format…

If I am wrong with any of the above, please just let me know the correct way to understand it.

Thank you!
qwertiio
Posts: 3
Joined: Fri Jul 21, 2023 1:23 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by qwertiio »

RESET_9999 wrote:
Wed Aug 02, 2023 2:38 pm
interesting new options in the new dolby vision tools pack:

https://slow.pics/c/5irgGGKG
L1 Analysis Tuning:
Index Title
0 Legacy CM4 L1
1 Most Highlight Detail/Most Mapping
2 More Highlight Detail/More Mapping
3 Balanced
4 Less Highlight Detail/Less Mapping
5 Least Highlight Detail/Least Mapping
Analysis tuning provides user control over the strength of filtering used during analysis. Six options are
provided that match the options found in partner tools after updating to the 2023 New CM4 L1. As the
index increases, so does the amount of filtering, lowering the L1 max.
Stronger filters may result in clipping of fine details in the highlights while reducing the amount of
mapping. By default, cm_analyze uses the 1 – Most Highlight Detail / Most Mapping
with the intent of preserving as much highlight detail as possible, with the exception of when the --
live-infinite-filter option is invoked. In this case, the analysis defaults to 0 – Legacy CM4
L1 to match the Dolby Live Distribution Processor product
Dolby is please to announce the immediate availability of the Dolby Vision Professional Tools v5.4, available now at customer.dolby.com.

New Feature Summary in this release
New L1 analysis features in cm_analyze
Added 2023 New L1 frame statistics algorithm with user-tuneable spatial filtering, new hybrid mid measurement, unified gamut analysis, and improved black measurement.
New statistics are enabled by default, and tuning can be adjusted using --analysis-tuning <arg>
See the user manual for more information
Older frame statistics are available using --legacy-cm4-l1
Improved file-based long play analysis algorithm
New temporal smoothing algorithm
New backwards compatibility metadata for frame-by-frame analysis
New difference detection to group scenes together
Added --live-infinite-filter to match analysis done in Dolby's Live Distribution Processor
Added new stereoscopic analysis for shot based and file based / frame-by-frame analysis. Right eye view can be added using --input2 <rightEye>
Added new global looks that can be added to your analysis, using --global-trims <globalLook.xml>.
See the user manual for more information
--source-format now requires both the transfer function (pq) and color gamut (p3d65 or bt2020)
• Added new functions in metafier for handling per-shot L5:
--validate performs new checks & reports
looks for and validates per-shot L5. An error will be reported if the per-shot canvas does not match the global canvas
Examines CM 4 XMLs (v4.0.2 & v5.1.0) for "illegal" legacy L1 values.
Separate count for default Target ID 1 L8 trims
--aspect-ratios <arg1> <arg2> now updates canvas of per-shot L5 and removes
See the user manual for more information
--preserve-per-shot-active preserve the current global active aspect ratio as per-shot L5 when updating aspect ratios
--global-trims <globalLook.xml> can inject a global look by applying specified trims to all shots & frames within an existing XML
See the user manual for more information
Cm_offline improvements:
Added new 300 nits P3D65 & BT.2020 targets to cm_offline
Added flag --skip-qt-st2086-min-check to permit cm_offline to continue when a QuickTime MOV's ST.2086 minimum (mdcv) does not match the Dolby Vision master display minimum
Bug fixes in this release
Fixed minor analysis bugs from 5.4-beta-1
Fixed an issue with rejecting 4:2:0 subsampled jpeg2000 files.
Known issues
Some shell environments may require the use of quotes for each input XML file when using the command line reel frame range option

You can access the new product here:
https://customer.dolby.com/content-crea ... tools-v540
Best regards,
Dolby Laboratories, Inc.
I really need this :shock:

btw, any eta for this update on the script????
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

qwertiio wrote:
Thu Aug 03, 2023 11:01 am
I really need this :shock:

btw, any eta for this update on the script????
new beta is available. You need to update your cm_analyze.exe (can be downloaded on dolby website)
L1 tuning can be configured at line 62. Default mode (1) seems to produce the best result.

3-1 can now accept external shot list input which means it's possible to take the shot list from retail RPU and use it with the CM analysis for more accurate metadata.
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

bbeny123 wrote:
Wed Aug 02, 2023 2:15 pm

Nope, I've tested LG C9 only.
It also works well on my C2 but the 2018 or older TV are more picky in regard of DV MP4.

if anyone with old LG TVs could test the latest beta script, workflows 7-2, that would be great. You have to update the mp4muxer.exe by the one from here: https://github.com/bbeny123/mp4muxer
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
EncodeThis420
Posts: 8
Joined: Wed Aug 02, 2023 6:49 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by EncodeThis420 »

RESET_9999 wrote:
Thu Aug 03, 2023 2:09 pm
Sorry to reply to you directly but would you able to confirm my question on profile 8 hybrids? I can't find a diffinitive answer and it seems like EVERYONE is encoding with profile 8 hybrid formats now. I'm not seeing ANY native profile 5 formats any longer :-/. Do you see this as an issue? This is in reference to P5 streams combined with hdr10/+ streams, not hdr10 blurays that are combined with a p5 stream.
Chisum04
Posts: 17
Joined: Mon Feb 27, 2023 10:43 am

Re: Dolby Vision now possible through MP4 Mux.

Post by Chisum04 »

RESET_9999 wrote:
Thu Aug 03, 2023 2:09 pm


if anyone with old LG TVs could test the latest beta script, workflows 7-2, that would be great.
I tested DV-Profile 8.1 with my Oppo, it played only HDR. Built-in Player in my Sony XR 90 plays Dolby. That is a pity, because ver 1.3 is really fast. Only ver 1.0 works reliable for my Oppo.
RESET_9999
Posts: 2406
Joined: Mon Aug 05, 2019 7:12 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by RESET_9999 »

EncodeThis420 wrote:
Thu Aug 03, 2023 2:38 pm
Sorry to reply to you directly but would you able to confirm my question on profile 8 hybrids? I can't find a diffinitive answer and it seems like EVERYONE is encoding with profile 8 hybrid formats now. I'm not seeing ANY native profile 5 formats any longer :-/. Do you see this as an issue? This is in reference to P5 streams combined with hdr10/+ streams, not hdr10 blurays that are combined with a p5 stream.
making p8 hybrid is not an issue as long as you make sure the P5 and HDR10 encode are the same brightness/master. I have a huge excel sheet about it in my signature.
Most of the p2p or scene groups make hybrid without checking any of this and it is a problem especially if they are not going to release the profile 5 source which seems to happen more frequently lately.
While most of the time, the P5 and HDR10 encode are from the same source/master, it doesn't mean it will always be the same, and making hybrid releases blindly is wrong.
And sometimes studios decide to deliver different trim pass even though it's from the same master.

two examples I came across recently:
Black Widow profile 5 iMAX is much brighter than the HDR10 IMAX web-dl: https://slow.pics/c/zzHW5Qhv
And recently Hot Pursuit (which FLUX only released hybrid P8): https://slow.pics/c/37t2bB4J
Sorry for my English.
G5 / AM6B+ / Denon 7.2.4
DoVi_Scripts
DoVi Playback Devices
EncodeThis420
Posts: 8
Joined: Wed Aug 02, 2023 6:49 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by EncodeThis420 »

RESET_9999 wrote:
Thu Aug 03, 2023 4:49 pm
EncodeThis420 wrote:
Thu Aug 03, 2023 2:38 pm
Sorry to reply to you directly but would you able to confirm my question on profile 8 hybrids? I can't find a diffinitive answer and it seems like EVERYONE is encoding with profile 8 hybrid formats now. I'm not seeing ANY native profile 5 formats any longer :-/. Do you see this as an issue? This is in reference to P5 streams combined with hdr10/+ streams, not hdr10 blurays that are combined with a p5 stream.
making p8 hybrid is not an issue as long as you make sure the P5 and HDR10 encode are the same brightness/master. I have a huge excel sheet about it in my signature.
Most of the p2p or scene groups make hybrid without checking any of this and it is a problem especially if they are not going to release the profile 5 source which seems to happen more frequently lately.
While most of the time, the P5 and HDR10 encode are from the same source/master, it doesn't mean it will always be the same, and making hybrid releases blindly is wrong.
And sometimes studios decide to deliver different trim pass even though it's from the same master.

two examples I came across recently:
Black Widow profile 5 iMAX is much brighter than the HDR10 IMAX web-dl: https://slow.pics/c/zzHW5Qhv
And recently Hot Pursuit (which FLUX only released hybrid P8): https://slow.pics/c/37t2bB4J
Thanks. This is kind of what I was afraid of. There's really no way (for a normal person like myself) to tell whether a "hybrid" encode was done properly. I'm basically seeing ONLY hybrid files for all new streaming shows being encoded. These encoders are not posting the original profile 5 sources which is absolutely infuriating. I rather just grab P5 versions so that I know that it has the correct brightness. Why in the world are people not doing this? What changed? Is there any possible way to like "reverse engineer" these files to split back out the p5 stream? or is that impossible?
bbeny123
Posts: 19
Joined: Tue Aug 01, 2023 6:33 pm

Re: Dolby Vision now possible through MP4 Mux.

Post by bbeny123 »

Chisum04 wrote:
Thu Aug 03, 2023 3:56 pm
I tested DV-Profile 8.1 with my Oppo, it played only HDR. Built-in Player in my Sony XR 90 plays Dolby. That is a pity, because ver 1.3 is really fast. Only ver 1.0 works reliable for my Oppo.
My fixes were focused on DV-Profile 7 (dual track), but it is possible that version 1.3.2 will also work with the Oppo.

1.3.2-alpha1: https://github.com/bbeny123/mp4muxer/re ... 3.2-alpha1

If 1.3.2-alpha1 still does not work, you can also try 1.3.2-alpha2: https://github.com/bbeny123/mp4muxer/re ... 3.2-alpha2
Post Reply