|
|
Post by slagothor on Jul 1, 2021 12:21:38 GMT
Well, I found a Chinese site where it looks like someone is working on a solution. They have some code examples, but unfortunately Google translate will only pick out a few words so I couldn't make out if it was even successful or not. But it does at least look like someone is deep diving into the file format. If I find a solution, I'll definitely post it here.
|
|
|
|
Post by slagothor on Jul 1, 2021 12:22:28 GMT
|
|
|
|
Post by slagothor on Jul 1, 2021 12:49:02 GMT
Ok, just an update. No full solution on the converting of the new .bin format, but I've saved hundreds of links to older models and whenever I pull them up, they appear to still be in the old .gs format. I'll test further in the next couple of days.
|
|
|
|
Post by dlight on Jul 1, 2021 14:17:24 GMT
can confirm, it's possible to get the raw files this way. for some reason both the 2018 and 2019 version of the blender script throw a key error tho and won't import them.
|
|
|
|
Post by Warhammer_81 on Jul 1, 2021 15:39:48 GMT
Just FYI the .binz format is not really new, it’s related to the WebGL viewer format. Sketchfab is trying to update their viewer to work with the latest specs, hence the format change. From the Chinese website linked above, “Note that Sketchfab currently encrypts all the model files twice, the format is binz, and the decrypted format is still file.osgjs.gz and model_file.bin.gz. The key logic of decryption is executed immediately after the request model file is completed. Those with a little knowledge of front-end debugging can interrupt the decryption point. There is no automatic processing method yet”. They explain how to manually decrypt the binz file and extract the files from it. When the Blender osgjs import script throws up an error, “IndexError: list index out of range” the solution is to comment out lines 330-351 of the Python 2.6.6 script code. Here’s the script they’re using: cdn.imjad.cn/usr/uploads/Blender249%5Bosgjs%5D.zip |
|
|
|
Post by slagothor on Jul 3, 2021 2:30:13 GMT
Thanks Warhammer,
I just didn't quite follow how he is running the other scripts. Is it in Chrome? If so what are the steps? I've never really done any debugging (not a coder). If you have successfully managed to do this can you just clarify this process a little better? Thanks mate!
|
|
holy
New Member Lvl 1
Posts: 2
|
Post by holy on Jul 3, 2021 20:41:26 GMT
hello when I run the RUN_ME.bat it just says some stuff then crashes without opening blender PLEASE help me because this is DRIVING ME NUTS
|
|
|
|
Post by ubermensch on Jul 17, 2021 15:34:00 GMT
Thanks for the guide. I tried it and spent hours trying to get it to work, but gave up. Can anyone here help me and try this file and see if you can get the model out of it? *snip* Maybe it's just something wrong on my end, not sure.
|
|
vido
New Member Lvl 1
Posts: 5
|
Post by vido on Jul 18, 2021 19:38:26 GMT
Hi guys
I was able to rip .osgjs page from that chinese page but not model_file.bin and wireframe file
|
|
|
|
Post by Rancor022 on Jul 18, 2021 21:58:44 GMT
It seems whenever newbies start asking questions one of those spam accounts comes in to post. If that happens again I'm just going to straight-up lock this thread and only allow mods to post tutorials here.
|
|
vido
New Member Lvl 1
Posts: 5
|
Post by vido on Jul 20, 2021 22:14:35 GMT
Hi guys, here I will write briefly what you gone need to do to download unencrypted "binz" model's from Sketchfab Open Chrome and Dev tools (F12), make tool horizontal and go to "Sources" and close all files in sources, hit "Ctrl + Shift + F" and type "this._xhr=" and hit enter, double click on bottom text line to open it Click on "{}" to format code and hit "Ctrl +F" and find this line of code
this._xhr = {
response: i,
responseText: i
and insert break point at this line "his._xhr =" and reload page with "Ctrl + R", after that you will hit first break point and then go to "Console" and paste this code
var downloadBlob, downloadURL;
downloadBlob = function(data, fileName, mimeType) {
var blob, url;
blob = new Blob([data], {
type: mimeType
});
url = window.URL.createObjectURL(blob);
downloadURL(url, fileName);
setTimeout(function() {
return window.URL.revokeObjectURL(url);
}, 1000);
};
downloadURL = function(data, fileName) {
var a;
a = document.createElement('a');
a.href = data;
a.download = fileName;
document.body.appendChild(a);
a.style = 'display: none';
a.click();
a.remove();
};
downloadBlob(i, 'file.osgjs', 'application/octet-stream');
Hit "Enter" and save it in some directory. Reload page skip first break point by clicking on blue arrow (blue triangle) and paste code once more in Console from above "var downloadBlob, downloadURL; ...." just change name at bottom from "file.osgjs" to "model_file.bin" and that you will see blue bar go to up to half on load indicator . Now go in "Sources" and add second break point where "t ()" is line 33771 and reload page, click twice on first break point (blue triangle) and again hit twice "continue button blue triangle" to continue and click twice to continue once more time and after that you will see your model so paste code in Console and name it "model_file_wireframe.bin" and save it. When you do all that open "file.osgjs" in text editor and open "find and replace" tool and replace all ."binz" with ".bin.gz". Open Blender and hit Alt+P and open "file.osgjs" and that's it Or you can follow my video tutrial which is on mega with other necessary files and codes mega.nz/folder/cYZxDYIA#QcEoO-VY9kDQJqJYyXpsbA |
|
didari
New Member Lvl 1
Posts: 2
|
Post by didari on Jul 21, 2021 10:41:29 GMT
vido, Hi and thank you for your tutorial, it seems to be working on your video BUT could you make one for Windows? Thank you!
|
|
vido
New Member Lvl 1
Posts: 5
|
Post by vido on Jul 21, 2021 15:13:17 GMT
vido , Hi and thank you for your tutorial, it seems to be working on your video BUT could you make one for Windows? Thank you! That blender is for windows the steps are the same |
|
drlazo
New Member Lvl 1
Posts: 2
|
Post by drlazo on Jul 21, 2021 20:50:20 GMT
Lots of great information being shared in this thread and it's awesome! So when it comes to the only (paid) software that rips Sketchfab models out right now... I did some reverse engineering like a good boy & found out how they do it within minutes of it's debug. The program basically just takes the link you give it and searches www.web.archive.org for resources before the "security update" on SF. Example: Sketch fab link: *snip*
Archive page: *snip*
It is on the archive page that you extract all your necessary files for decrypting with original method mention on page 1. *Use Chrome*
I'd say from testing it so far it can recover a models file format 80% of the time granted it's before March (from what I believe this is around the time they implemented higher security?) Basically the Sketchfab ripper site makes you pay $50 for them to slap a URL in-front of another URL and convert it for you... not really worth the money IMO. I have every intend on cracking said software and giving it out to anyone who wants it, beyond me... who the hell tries to make money off of selling software that steals paid assets? Not spending money is the entire point of trying to rip models?... baffling.For recent above method, haven't tried it out yet but I am very eager to try it!  Thanks for the tutorial! |
|
|
|
Post by Warhammer_81 on Jul 21, 2021 21:20:17 GMT
Lots of great information being shared in this thread and it's awesome! So when it comes to the only (paid) software that rips Sketchfab models out right now.... The website selling the ripper software stole assets from the original software which was already 100% free and they also included some licensed Blender assets without any permissions as well! This is why we won't share links to their website or software. |
|
drlazo
New Member Lvl 1
Posts: 2
|
Post by drlazo on Jul 21, 2021 21:53:09 GMT
Lots of great information being shared in this thread and it's awesome! So when it comes to the only (paid) software that rips Sketchfab models out right now.... The website selling the ripper software stole assets from the original software which was already 100% free and they also included some licensed Blender assets without any permissions as well! This is why we won't share links to their website or software. That's insane! I hope they're not making money, it's highly doubtful they do though. The reason they do incredibly low poly assets for the demo is because they're more likely to be older models so the program looks functional when really it can't do newer assets. Thank you for letting me know Warhammer (good game btw) that only makes me want to crack this shi*ty program even more. It'll only take a few minutes so when I get some time today or tomorrow, I'll see what I can do > 
|
|
holy
New Member Lvl 1
Posts: 2
|
Post by holy on Jul 22, 2021 7:01:56 GMT
hey can you tell me when you finish that my discord is holy#2082 I really wanna get some models for reference off sketchfab
|
|
will67
New Member Lvl 1
Posts: 3
|
Post by will67 on Jul 25, 2021 2:41:38 GMT
I've been trying for the past month to get this model. I've tried both the ninjaripper & blender methods, as well as trying to build the model myself from photo dl's using assorted 2d/3d software... Nothing has worked.
Hopefully someone here can help. here's the 2 bins I did manage to download last month, as well as the current link. I actualy haven't been able to reproduce the dl using the chrome method since that one time, which may have to do with the new security measures...
modelfile & modelfile wireframe bins (7zip)-
*snip*
SF link
*snip*
Any help will be greatly appreciated, Will
|
|
|
|
Post by silvermoonlight0000 on Jul 26, 2021 1:54:57 GMT
will67 , you need "file.osgjs.gz and model_file.bin.gz" not "model_file.bin.gz and model_file_wireframe.bin.gz", this one doesnt have binz format so just download the two and import with 2.49 script
|
|
will67
New Member Lvl 1
Posts: 3
|
Post by will67 on Jul 26, 2021 17:48:44 GMT
Ugh.. That's the problem. I haven't been able to repeat the download since the one time I got the 2 files... I also haven't been able to get the blender script to work properly... It loads, fills the script screen, then nothing... I know next to nothing about blender, as I only use it to convert models to obj's. I'll keep trying, thanks. |
|
will67
New Member Lvl 1
Posts: 3
|
Post by will67 on Jul 26, 2021 19:14:08 GMT
OK, finaly got it to work, Thanks! One thing I had to do was switch to a different blender pack. For some reason the one posted earlier just wouldn't work for me, as the script kept coming up as an error. This one worked first try...
|
|
kikos
New Member Lvl 1
Posts: 5
|
Post by kikos on Sept 18, 2021 6:26:18 GMT
Hi guys, here I will write briefly what you gone need to do to download unencrypted "binz" model's from Sketchfab Open Chrome and Dev tools (F12), make tool horizontal and go to "Sources" and close all files in sources, hit "Ctrl + Shift + F" and type "this._xhr=" and hit enter, double click on bottom text line to open it Click on "{}" to format code and hit "Ctrl +F" and find this line of code
this._xhr = {
response: i,
responseText: i
and insert break point at this line "his._xhr =" and reload page with "Ctrl + R", after that you will hit first break point and then go to "Console" and paste this code
var downloadBlob, downloadURL;
downloadBlob = function(data, fileName, mimeType) {
var blob, url;
blob = new Blob([data], {
type: mimeType
});
url = window.URL.createObjectURL(blob);
downloadURL(url, fileName);
setTimeout(function() {
return window.URL.revokeObjectURL(url);
}, 1000);
};
downloadURL = function(data, fileName) {
var a;
a = document.createElement('a');
a.href = data;
a.download = fileName;
document.body.appendChild(a);
a.style = 'display: none';
a.click();
a.remove();
};
downloadBlob(i, 'file.osgjs', 'application/octet-stream');
Hit "Enter" and save it in some directory. Reload page skip first break point by clicking on blue arrow (blue triangle) and paste code once more in Console from above "var downloadBlob, downloadURL; ...." just change name at bottom from "file.osgjs" to "model_file.bin" and that you will see blue bar go to up to half on load indicator . Now go in "Sources" and add second break point where "t ()" is line 33771 and reload page, click twice on first break point (blue triangle) and again hit twice "continue button blue triangle" to continue and click twice to continue once more time and after that you will see your model so paste code in Console and name it "model_file_wireframe.bin" and save it. When you do all that open "file.osgjs" in text editor and open "find and replace" tool and replace all ."binz" with ".bin.gz". Open Blender and hit Alt+P and open "file.osgjs" and that's it Or you can follow my video tutrial which is on mega with other necessary files and codes mega.nz/folder/cYZxDYIA#QcEoO-VY9kDQJqJYyXpsbAThanks for the tutorial and all the time and sharing it, i was able to load the model from Sketchfab, but the only part that didn't worked for me was the textures, Dump.py and the id just doesn't work. After Python Dump.py and Enter i receive this. Traceback (most recent call last): File "Dump.py", line 7, in <module> from bs4 import BeautifulSoup ModuleNotFoundError: No module named 'bs4' Do you know how how to fix this? Thanks a lot in advance. Greetings. |
|
|
|
Post by ziptag55 on Oct 20, 2021 22:31:26 GMT
Is there any way to use this method for models with animations applied? Any time I rip one with animations, it turns into a jumbled mesh similar to meshes with corrupted blendshapes.
|
|
fraks
New Member Lvl 1
Posts: 1
|
Post by fraks on Oct 26, 2021 3:19:33 GMT
How do you insert the Id in Dump.py? I didn't really understand from the tutorial. Sorry for not knowing much about coding.
|
|
|
|
Post by slagothor on Nov 5, 2021 21:46:41 GMT
Hey guys,
Just wanted to let you know that vido's tutorial works great! Thanks vido!
|
|
|
|
Post by cerealpirate on Nov 15, 2021 18:45:22 GMT
scratch that ... thanks Vido !! just a bad case of thinking i got the process when I should have re watched the video smh ... noob SFR here lol
|
|
|
|
Post by motoroil on Nov 17, 2021 2:01:54 GMT
Hi guys, here I will write briefly what you gone need to do to download unencrypted "binz" model's from Sketchfab Open Chrome and Dev tools (F12), make tool horizontal and go to "Sources" and close all files in sources, hit "Ctrl + Shift + F" and type "this._xhr=" and hit enter, double click on bottom text line to open it Click on "{}" to format code and hit "Ctrl +F" and find this line of code
this._xhr = {
response: i,
responseText: i
and insert break point at this line "his._xhr =" and reload page with "Ctrl + R", after that you will hit first break point and then go to "Console" and paste this code
var downloadBlob, downloadURL;
downloadBlob = function(data, fileName, mimeType) {
var blob, url;
blob = new Blob([data], {
type: mimeType
});
url = window.URL.createObjectURL(blob);
downloadURL(url, fileName);
setTimeout(function() {
return window.URL.revokeObjectURL(url);
}, 1000);
};
downloadURL = function(data, fileName) {
var a;
a = document.createElement('a');
a.href = data;
a.download = fileName;
document.body.appendChild(a);
a.style = 'display: none';
a.click();
a.remove();
};
downloadBlob(i, 'file.osgjs', 'application/octet-stream');
Hit "Enter" and save it in some directory. Reload page skip first break point by clicking on blue arrow (blue triangle) and paste code once more in Console from above "var downloadBlob, downloadURL; ...." just change name at bottom from "file.osgjs" to "model_file.bin" and that you will see blue bar go to up to half on load indicator . Now go in "Sources" and add second break point where "t ()" is line 33771 and reload page, click twice on first break point (blue triangle) and again hit twice "continue button blue triangle" to continue and click twice to continue once more time and after that you will see your model so paste code in Console and name it "model_file_wireframe.bin" and save it. When you do all that open "file.osgjs" in text editor and open "find and replace" tool and replace all ."binz" with ".bin.gz". Open Blender and hit Alt+P and open "file.osgjs" and that's it Or you can follow my video tutrial which is on mega with other necessary files and codes mega.nz/folder/cYZxDYIA#QcEoO-VY9kDQJqJYyXpsbAeach time i try to open the file to rename stuff in the file it this happens? any fixes? Attachments:
|
|
|
|
Post by jocelius on Nov 18, 2021 19:22:58 GMT
is working normally! I just made one here! either file will not!
|
|
chazz
New Member Lvl 1
Posts: 1
|
Post by chazz on Nov 22, 2021 9:58:02 GMT
Hi, this script works perfectly with chrome and windows.
|
|
zorba
New Member Lvl 1
Posts: 1
|
Post by zorba on Nov 25, 2021 23:29:31 GMT
Hey lads..
this thread been a ton of help, got me understanding what to do, however..
after trying for some time I managed to get the file.osgjs , model_file.bin and the model_file_wireframe.bin..
when I open my file.osgjs in a windows text editor i get gibberish, cant find nor replace my texts.
I gave 0 experience in scripting, and im a novice in blender.. can I get some help?
|
|
Thanks for the tutorial!
