Ripping 4K UHD Disks

Everything related to MakeMKV
d00zah
Posts: 1583
Joined: Mon Jun 06, 2016 8:23 pm

Re: Ripping 4K UHD Disks

Post by d00zah »

Ritzter13 wrote:
Tue May 14, 2024 12:20 pm
Thank you for your help. Let me know if there is anything else I can provide. I have 2 .tgz zip folders from movie failures as well.
d00zah wrote:
Mon May 13, 2024 11:08 pm
...
but I don't see any specifics about the failure. It would be very helpful if you could copy/paste the MakeMKV output... from the bottom pane starting w/:

MakeMKV v1.17.6 win(x64-release) started

after attempting a rip so we can see exactly how it failed?

My suspicion is it's related to using automatically assigned (ISP) DNS servers, but let's start w/ what MakeMKV reports.
Drive Information
OS device name: \Device\CdRom1
Current profile: BD-ROM
Manufacturer: ASUS
Product: BW-16D1HT
Revision: 3.10
Serial number: KLMJB695502
Firmware date: 2119-01-04 10:14
Bus encryption flags: 1F
Highest AACS version: 76

LibreDrive Information
Status: Enabled
Drive platform: MT1959
Firmware type: Patched (microcode access re-enabled)
Firmware version: 3.10
DVD all regions: Yes
BD raw data read: Yes
BD raw metadata read: Yes
Unrestricted read speed: Yes

Disc Information
Label: FANTASTIC_BEASTS
Timestamp: 2017-01-23 23:39:30
Protection: AACS2.0/C v61
Data capacity: 59.20 Gb
Disc type: BD-ROM UHD
Number of layers: 2
Bus encryption flags: 80

MakeMKV v1.17.6 win(x64-release) started
Using LibreDrive mode (v06.3 id=0FA242DD4D0B)
Using direct disc access mode
Loaded content hash table, will verify integrity of M2TS files.
Downloading latest HK to C:\Users\redwi/.MakeMKV ...
Automatic HK downloading is disabled or failed.
Saved AACS dump file as C:\Users\redwi/.MakeMKV/MKB20_v61_Fantastic_Beasts_and_Where_to_Find_Them_2225.tgz
The volume key is unknown for this disc - video can't be decrypted
Failed to open disc


I get a similar type of failure for any 4K disk I attempt to rip.

This is a copy of what's in my host file:

# Copyright (c) 1993-2009 Microsoft Corp.
#
# This is a sample HOSTS file used by Microsoft TCP/IP for Windows.
#
# This file contains the mappings of IP addresses to host names. Each
# entry should be kept on an individual line. The IP address should
# be placed in the first column followed by the corresponding host name.
# The IP address and the host name should be separated by at least one
# space.
#
# Additionally, comments (such as these) may be inserted on individual
# lines or following the machine name denoted by a '#' symbol.
#
# For example:
#
# 102.54.94.97 rhino.acme.com # source server
# 38.25.63.10 x.acme.com # x client host

# localhost name resolution is handled within DNS itself.
# 127.0.0.1 localhost
# ::1 localhost


185.84.108.20 hkdata.crabdance.com hkdata.fairuse.org
nslookup on either domain (hkdata.crabdance.com / hkdata.fairuse.org) reports non-existent for me, so the intel in that thread is likely old news.

Rather than using automatically assigned (ISP) DNS servers, try:

- setting DNS to 8.8.8.8 (google) & 1.1.1.1 (cloudflare)
- remove 'hosts' entries (MIGHT require reboot?)
- execute 'ipconfig /flushdns' from a command prompt

and retry scanning disc to see if 'Automatic HK download' still fails.
segfaulted
Posts: 92
Joined: Mon May 06, 2024 11:10 am

Re: Ripping 4K UHD Disks

Post by segfaulted »

From what I can see, makemkv checks a different domain now using an encrypted DNS lookup. The ip address to the server is still the same as before.
Ritzter13
Posts: 24
Joined: Mon May 31, 2021 11:30 pm

Re: Ripping 4K UHD Disks

Post by Ritzter13 »

d00zah wrote:
Tue May 14, 2024 12:36 pm
nslookup on either domain (hkdata.crabdance.com / hkdata.fairuse.org) reports non-existent for me, so the intel in that thread is likely old news.

Rather than using automatically assigned (ISP) DNS servers, try:

- setting DNS to 8.8.8.8 (google) & 1.1.1.1 (cloudflare)
- remove 'hosts' entries (MIGHT require reboot?)
- execute 'ipconfig /flushdns' from a command prompt

and retry scanning disc to see if 'Automatic HK download' still fails.
I won't have any time over the next two days to work on this. I will look into this on Friday and report back.
Ritzter13
Posts: 24
Joined: Mon May 31, 2021 11:30 pm

Re: Ripping 4K UHD Disks

Post by Ritzter13 »

oddeyeball wrote:
Mon May 13, 2024 11:26 pm
I wonder if your drive is doing what two of mine did. Mine just stopped being able to rip UHD disks over time, sometime after 200 rips. Happened with both of my WH16NS60 drives. They both can rip DVDs and Blu-rays, just not UHD. My BP50NB40 and BP60NB10 drives work fine with UHD disks.

Can you post the error you are getting from the log?
Here is the log file text contained in the MK820_v76_save.tgz folder. This is contained in the Users/$NAME$/.MakeMKV folder.

Debug log started at Mon May 13 14:44:23 2024 , written by MakeMKV v1.17.6 win(x64-release)
001005:0000 MakeMKV v1.17.6 win(x64-release) started
Using 262272KB for read cache.
Network access is ENABLED, CURL version 7.72.0/Schannel/1.41.0 (x86_64-pc-win32) , proxy server not set.
003338:0000 Downloading latest SDF to C:\Users\redwi/.MakeMKV ...
DEBUG: Code 4279336995 at 3`QAU{aoohl+yr@:121262877
003339:0000 Automatic SDF downloading is disabled or failed.
DEBUG: Code 152 at WKYQi`r2nRn]/W8S:213144911
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v097: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v097: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
d00zah
Posts: 1583
Joined: Mon Jun 06, 2016 8:23 pm

Re: Ripping 4K UHD Disks

Post by d00zah »

Ritzter13 wrote:
Fri May 17, 2024 12:30 pm
oddeyeball wrote:
Mon May 13, 2024 11:26 pm
I wonder if your drive is doing what two of mine did. Mine just stopped being able to rip UHD disks over time, sometime after 200 rips. Happened with both of my WH16NS60 drives. They both can rip DVDs and Blu-rays, just not UHD. My BP50NB40 and BP60NB10 drives work fine with UHD disks.

Can you post the error you are getting from the log?
Here is the log file text contained in the MK820_v76_save.tgz folder. This is contained in the Users/$NAME$/.MakeMKV folder.

Debug log started at Mon May 13 14:44:23 2024 , written by MakeMKV v1.17.6 win(x64-release)
001005:0000 MakeMKV v1.17.6 win(x64-release) started
Using 262272KB for read cache.
Network access is ENABLED, CURL version 7.72.0/Schannel/1.41.0 (x86_64-pc-win32) , proxy server not set.
003338:0000 Downloading latest SDF to C:\Users\redwi/.MakeMKV ...
DEBUG: Code 4279336995 at 3`QAU{aoohl+yr@:121262877
003339:0000 Automatic SDF downloading is disabled or failed.
DEBUG: Code 152 at WKYQi`r2nRn]/W8S:213144911
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v097: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v097: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
Progress! IF that key is available, disc should rip now. IF the key is not available, email MK820_v76_save.tgz to svq@makemkv.com (you probably know the drill?) & wait for Mike to process.
Ritzter13
Posts: 24
Joined: Mon May 31, 2021 11:30 pm

Re: Ripping 4K UHD Disks

Post by Ritzter13 »

I've tried all the suggested advice and fixes. No joy in getting the 4K disk to decode for ripping. I would think the 4K disks shown below are old enough and should have keys for decoding. What part of the .tgz folder should I submit in the future to request new HK keys?

Here are log files from two different movie .tgz folders.
The movies are Fantastic Beasts and Where to Find Them; Mission: Impossible (1).

Fantastic Beasts
Debug log started at Fri May 17 13:07:57 2024 , written by MakeMKV v1.17.6 win(x64-release)
001005:0000 MakeMKV v1.17.6 win(x64-release) started
Using 262272KB for read cache.
Network access is ENABLED, CURL version 7.72.0/Schannel/1.41.0 (x86_64-pc-win32) , proxy server not set.
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: PIONEER_BD-RW___BDR-212U_1.00_SIDL000730WL
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
001011:0000 Using LibreDrive mode (v06.3 id=0FA242DD4D0B)
003007:0000 Using direct disc access mode
005085:0000 Loaded content hash table, will verify integrity of M2TS files.
DEBUG: Code 2147483648 at WKYQi`r2nRn]/W8S:121265499
003338:0000 Downloading latest HK to C:\Users\redwi/.MakeMKV ...
DEBUG: Code 4279336995 at 3`QAU{aoohl+yr@:121262877
DEBUG: Code 0 at WKYQi`r2nRn]/W8S:29400163
003339:0000 Automatic HK downloading is disabled or failed.


Mission: Impossible
Debug log started at Fri May 17 13:46:25 2024 , written by MakeMKV v1.17.6 win(x64-release)
001005:0000 MakeMKV v1.17.6 win(x64-release) started
Using 262272KB for read cache.
Network access is ENABLED, CURL version 7.72.0/Schannel/1.41.0 (x86_64-pc-win32) , proxy server not set.
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: PIONEER_BD-RW___BDR-212U_1.00_SIDL000730WL
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
DEBUG: Code 3 at (Fjq;j%;wku%(|]PM?.".JoL:29395310
SDF v098: ASUS_BW-16D1HT_3.10_211901041014_KLMJB695502
001011:0000 Using LibreDrive mode (v06.3 id=0FA242DD4D0B)
003007:0000 Using direct disc access mode
005085:0000 Loaded content hash table, will verify integrity of M2TS files.
DEBUG: Code 2147483648 at WKYQi`r2nRn]/W8S:121265499
003338:0000 Downloading latest HK to C:\Users\redwi/.MakeMKV ...
DEBUG: Code 4279336995 at 3`QAU{aoohl+yr@:121262877
DEBUG: Code 0 at WKYQi`r2nRn]/W8S:29400163
003339:0000 Automatic HK downloading is disabled or failed.
d00zah
Posts: 1583
Joined: Mon Jun 06, 2016 8:23 pm

Re: Ripping 4K UHD Disks

Post by d00zah »

You've tried a VPN. You've tried alternative DNS servers. Something is blocking access... either a local firewall, or something upstream. What, if any, firewall do you use locally?

Have you tried any VPN endpoints outside of the EU?
Ritzter13
Posts: 24
Joined: Mon May 31, 2021 11:30 pm

Re: Ripping 4K UHD Disks

Post by Ritzter13 »

Just for the heck of it I put 185.84.108.20 in a browser and this is what came up.

403 Доступ запрещен

Если Вы владелец сайта, дополнительную информацию Вы можете узнать по e‑mail support@majordomo.ru

In English:

403 Access is prohibited

If you are the owner of the site, you can find out more information by e-mail support . . . . . . . . . . .
d00zah
Posts: 1583
Joined: Mon Jun 06, 2016 8:23 pm

Re: Ripping 4K UHD Disks

Post by d00zah »

Ritzter13 wrote:
Fri May 17, 2024 2:41 pm
Just for the heck of it I put 185.84.108.20 in a browser and this is what came up.

403 Доступ запрещен

Если Вы владелец сайта, дополнительную информацию Вы можете узнать по e‑mail support@majordomo.ru

In English:

403 Access is prohibited

If you are the owner of the site, you can find out more information by e-mail support . . . . . . . . . . .
I see the same. @segfaulted seems to think the domain has changed but the IP is the same? I haven't analyzed traffic, so I'm not in a position to dispute that, but I'm dubious. The 'hosts' mod is only valid if you KNOW the current domain & associate the IP. My router is configured for SmartDNS (CloudFlare/Quad9) & although I don't have a disc to test @ the moment, I have experienced no issues (VPN, or no)... ever. My $$ is still on local firewall, or upstream geo-blocking?

>nslookup 185.84.108.20
Server: [my router]
Address: 192.168.xx.254

Name: web33.majordomo.ru
Address: 185.84.108.20

>nslookup web33.majordomo.ru
Server: [my router]
Address: 192.168.xx.254

Non-authoritative answer:
Name: web33.majordomo.ru
Address: 185.84.108.20

>nslookup hkdata.crabdance.com
Server: [my router]
Address: 192.168.xx.254

*** [my router] can't find hkdata.crabdance.com: Non-existent domain

>nslookup hkdata.fairuse.org
Server: [my router]
Address: 192.168.xx.254

*** [my router] can't find hkdata.fairuse.org: Non-existent domain
dcoke22
Posts: 3078
Joined: Wed Jul 22, 2020 11:25 pm

Re: Ripping 4K UHD Disks

Post by dcoke22 »

My ISP does not block my access and I was able to download new HKs earlier this week. My DNS is set to Cloudflare (1.1.1.1)

On this forum, lots of Comcast/Xfinity customers have had upstream blocking problems that required either a VPN or turning off some kind of advanced security setting on their router (https://forum.makemkv.com/forum/viewtopic.php?p=151241#p151241). One guy said his worked when he tethered to his cellular phone connection. I'm sure plenty of other ISPs are being 'helpful' as well.

If your local firewall is preventing DNS over HTTPS, that might also prevent MakeMKV from downloading new HKs. (https://forum.makemkv.com/forum/viewtopic.php?p=150613#p150613)
segfaulted
Posts: 92
Joined: Mon May 06, 2024 11:10 am

Re: Ripping 4K UHD Disks

Post by segfaulted »

d00zah wrote:
Fri May 17, 2024 3:21 pm
@segfaulted seems to think the domain has changed but the IP is the same? I haven't analyzed traffic, so I'm not in a position to dispute that, but I'm dubious. The 'hosts' mod is only valid if you KNOW the current domain & associate the IP. My router is configured for SmartDNS (CloudFlare/Quad9) & although I don't have a disc to test @ the moment, I have experienced no issues (VPN, or no)... ever. My $$ is still on local firewall, or upstream geo-blocking?
I did a wireshark capture to confirm that there is traffic going to 185.84.108.20, which was preceded by a DNS-over-HTTPS lookup through Google DNS.

From what I can tell, makemkv doesn't try to get the ip address from the hosts file, so that editing it won't be much help for the average user. But to show that it works, clicking this link should serve up a file (if the ip in the hosts file is still valid): http://hkdata.fairuse.org/svq/sdf.dat.gz

@Ritzter13
Let see if the DNS-over-HTTPS is working for you. Does this link open a download prompt? https://dns.google/dns-query?dns=AAABAA ... b20AABAAAQ

or alternatively: https://cloudflare-dns.com/dns-query?dn ... b20AABAAAQ

Those were the dns lookups that I observed when starting up makemkv.
d00zah
Posts: 1583
Joined: Mon Jun 06, 2016 8:23 pm

Re: Ripping 4K UHD Disks

Post by d00zah »

segfaulted wrote:
Fri May 17, 2024 6:13 pm
d00zah wrote:
Fri May 17, 2024 3:21 pm
@segfaulted seems to think the domain has changed but the IP is the same? I haven't analyzed traffic, so I'm not in a position to dispute that, but I'm dubious. The 'hosts' mod is only valid if you KNOW the current domain & associate the IP. My router is configured for SmartDNS (CloudFlare/Quad9) & although I don't have a disc to test @ the moment, I have experienced no issues (VPN, or no)... ever. My $$ is still on local firewall, or upstream geo-blocking?
I did a wireshark capture to confirm that there is traffic going to 185.84.108.20, which was preceded by a DNS-over-HTTPS lookup through Google DNS.

...
I stand corrected. That's the part I couldn't check 1st hand. Sorry to doubt.
Ritzter13
Posts: 24
Joined: Mon May 31, 2021 11:30 pm

Re: Ripping 4K UHD Disks

Post by Ritzter13 »

segfaulted wrote:
Fri May 17, 2024 6:13 pm
d00zah wrote:
Fri May 17, 2024 3:21 pm
@segfaulted seems to think the domain has changed but the IP is the same? I haven't analyzed traffic, so I'm not in a position to dispute that, but I'm dubious. The 'hosts' mod is only valid if you KNOW the current domain & associate the IP. My router is configured for SmartDNS (CloudFlare/Quad9) & although I don't have a disc to test @ the moment, I have experienced no issues (VPN, or no)... ever. My $$ is still on local firewall, or upstream geo-blocking?
I did a wireshark capture to confirm that there is traffic going to 185.84.108.20, which was preceded by a DNS-over-HTTPS lookup through Google DNS.

From what I can tell, makemkv doesn't try to get the ip address from the hosts file, so that editing it won't be much help for the average user. But to show that it works, clicking this link should serve up a file (if the ip in the hosts file is still valid): http://hkdata.fairuse.org/svq/sdf.dat.gz

@Ritzter13
Let see if the DNS-over-HTTPS is working for you. Does this link open a download prompt? https://dns.google/dns-query?dns=AAABAA ... b20AABAAAQ

or alternatively: https://cloudflare-dns.com/dns-query?dn ... b20AABAAAQ

Those were the dns lookups that I observed when starting up makemkv.
I clicked on all three. The results are:

1. http://hkdata.fairuse.org/svq/sdf.dat.gz > Launched a browser window that couldn't access the destination.

2. https://dns.google/dns-query?dns=AAABAA ... b20AABAAAQ and https://cloudflare-dns.com/dns-query?dn ... b20AABAAAQ > Both allowed me to download the same DNS Query file.
H4rd3n
Posts: 9
Joined: Mon Oct 24, 2022 7:17 am

Re: Ripping 4K UHD Disks

Post by H4rd3n »

Hi there.

I've got a weird problem, too. I wanted to try the newer hardware on my Laptop for AV1 encoding, but makemkv was not able to decrypt the Oppenheimer 4k disc and gave me a dump file. So I sent the dump and tried again today to no avail. I also used a powered USB hub to rule out the device has not enough power for the external drive. Then I uninstalled the newest 1.17.7 and tried the 1.17.5 from my desktop, which reads the disc with the same BDR-X07TUHD just fine. It shouldn't make any difference, that there is Windows 11 installed on the Laptop, while the Desktop runs Windows 10. But the Laptop still wasn't able to decrypt the disc.

I then connected the Laptop via an USB LAN adapter and shut down Wi-Fi, suddenly it worked! Which is strange, because both connect to the same router. Both are configured as a private network, so I can exchange files between devices, which works as intended.

So, what happened here? Is Wi-Fi too "slow" for retrieving the hashes for 4k discs? Lag too high?

Which may also be relevant for Ritzter13, if they changed something on their network? New NIC? Wi-Fi instead of cable? Maybe makemkv changed something in March/April, that affects connections via Wi-Fi?
Ritzter13
Posts: 24
Joined: Mon May 31, 2021 11:30 pm

Re: Ripping 4K UHD Disks

Post by Ritzter13 »

Some very good thoughts here. Thanks.
H4rd3n wrote:
Fri May 17, 2024 10:25 pm
Hi there.

I've got a weird problem, too. I wanted to try the newer hardware on my Laptop for AV1 encoding, but makemkv was not able to decrypt the Oppenheimer 4k disc and gave me a dump file. So I sent the dump and tried again today to no avail. I also used a powered USB hub to rule out the device has not enough power for the external drive. Then I uninstalled the newest 1.17.7 and tried the 1.17.5 from my desktop, which reads the disc with the same BDR-X07TUHD just fine. It shouldn't make any difference, that there is Windows 11 installed on the Laptop, while the Desktop runs Windows 10. But the Laptop still wasn't able to decrypt the disc.

I've had the same thoughts lately wondering if this could be a Win 11 update issue.


I then connected the Laptop via an USB LAN adapter and shut down Wi-Fi, suddenly it worked! Which is strange, because both connect to the same router. Both are configured as a private network, so I can exchange files between devices, which works as intended.

Now this is interesting. I'm going to look into this and get back with you. Actually I have my Xfinity router set to "Bridge Mode". I then connect everything thru my Linksys WRT3200 router. My devices work together well.

So, what happened here? Is Wi-Fi too "slow" for retrieving the hashes for 4k discs? Lag too high?

Which may also be relevant for Ritzter13, if they changed something on their network? New NIC? Wi-Fi instead of cable? Maybe makemkv changed something in March/April, that affects connections via Wi-Fi?
Post Reply