Ps3xport released!

On December 23, 2014, in Development, PS3, by kakaroto

Update : The method I spoke about below for getting your IDPs from an OFW console was released by flatz, look for his idpstealer release.  I have also fixed a major bug in ps3xport’s ExtractFile which corrupted data and ported ps3xport for windows. You can find the latest version (0.2 at the moment) on the github repository and I’ve built windows binaries here. Enjoy!

 

Hello everyone!

It’s been quite a long time and I’m very happy about that :p
Let’s do the boring part first! This is my final release for the scene, I am not “coming back” or anything like that, so don’t get your hopes up, but I needed to release this so I’d be officially done. I have never actually announced that I’m leaving the scene but everyone figured it out. It wasn’t originally done intentionally actually, but life caught up with me, work, family, lack of time, etc.. so I had little time to work on the ps3. Also, my motivation was mostly gone due to not finding anything interesting anymore, a lot of drama and I’m not a huge fan of all the attention this all brings. I got into the scene because I was curious and I wanted to learn, and I have to say I’ve learned a lot of things these past years and it was an incredible journey, but as I had lack of time and started breathing, I realized that I’ve had enough of it so I left and I am very happy with that decision because you have absolutely no idea how much of a time drain and headache this was :p
Anyways, there was one thing I did just before I left, but I never got to release it, but today is your lucky day as it’s release O’clock where I am!. This release is a way to say Merry Christmas, Happy Holidays, etc.. to everyone, and a way for me to also say “I’m done for good, I don’t have anything left for you in a drawer somewhere” :). I’ve wanted to release this for a while now, and I even made a poll on ps3hax back in March 2012 asking people if I should (looks like ps3hax is down right now so here’s the google cache version) and the general response was not to release it until it can be useful (when an npdrm workaround is found) with some people saying to release if nothing new happens in the scene.. and I think I’ve waited long enough now to know nothing new on that front will happen.

So.. since I’ve announced the release, I’ve seen a lot of speculation about what it is and what it could be.. a lot of people seem to think (or mostly, want/hope for) a downgrade method, unfortunately that’s not the case. I’ve seen some ridiculous suggestions too, like someone asking if it’s a way to run PS4 and Xbox One games on PS3.. I’m sorry to say, that’s not it either :p As I’ve said in a tweet shortly after, this is nothing groundbreaking, this is code that hasn’t been touched in 3 years, so it’s already 3 years old, but I think it’s still something that can be very useful to the community.

So here it is, I’m introducing to you : PS3xport! I’ve uploaded it to my github account here : https://github.com/kakaroto/ps3xport

What does it do? Well, it’s basically a tool for manipulating the PS3 backup data. When I say “PS3 backup”, I’m not talking about a “backup” of a game, no.. I’m talking about the full PS3 hard drive backup that you can do by going to “System Settings->Backup Utility” on your XMB. That creates an encrypted directory on your FAT32 hard drive which allows you to format your PS3 and then Restore it just like it was before. I’ve reverse engineered the file format and encryption and PS3xport allows you to create new backup data from scratch, or dump existing ones, or delete specific files from a backup or do a whole lot of other things to your backup folders. This gives you total control over your /dev_hdd0 and /dev_flash2 filesystems, which will let you install homebrew on any console, even if it’s the latest OFW version. Unfortunately, just like it was 3 years ago, you wouldn’t be able to run those homebrew apps you install due to the NPDRM ECDSA signature missing. If you have your IDPS though for example, it could let you restore a backup from one PS3 to another PS3 without losing any of your data in the transfer.

So.. what’s this about “your IDPS”? yes, the backup has two sets of files, some can be decrypted right away and some can’t because they are encrypted with your IDPS (your unique ps3 device id) which is why they can’t be restored on a different ps3. If you have a CFW, you can easily get your IDPS (I’ve written a small tool to do that, released on github, but apparently MM and Webman will also give you that information) and that will give you total control over your backup data as you would be able to decrypt and reencrypt it. If you have OFW and can’t get your IDPS, then you will not be able to dump/decode all the files from your backup, but you will still be able to create a backup that can be restored on your PS3 with no limitations (this means for example that you can restore a backup from a CFW into an OFW without any issues). I was told however that someone can get IDPS from OFW consoles and in light of this release, they might release their method soon, I can’t say more than that though, but be patient and good things come to those who wait :)

So my release is in two parts. First, the documentation of the file format was added to the ps3devwiki so any developer can understand how the backup archive files are created and can create their own tools. Reverse engineering that format took months of work and I won’t go into too much details about what had to be done to figure out the format but it was an incredibly long and difficult task to do that I had a lot of fun in doing. The second part of the release is of course the release of the ps3xport tool. The tool is quite powerful and you can do a lot of things with it, but it’s a command line only tool and I honestly just tested it on Linux, it’s not really my job at this point to make a windows build, or make a GUI around it, etc.. but I’m sure it won’t be long before others in the scene pick it up and make a nice GUI for it and release windows binaries. I’ve written a nice README file so everyone can understand how the tool works and what it can do. I remember though that 3 years ago just before I stopped working on it, I wanted to add a “AddPKG” command to it which would just ‘install’ a pkg into the backup data automatically, unfortunately, I never got to do it, but it should be easy to do. While I’m at it, I’m also releasing a pkg extraction tool which I found in an old directory (cool thing is the -p option in it, try it…) as well which is a PKG extraction tool that uses the PagedFile mechanism (see below) to allow for very fast pkg file access with very little memory usage even for huge pkg files, any dev can probably mix those two together to add the AddPKG feature to ps3xport.

On the software front, ps3xport.c will parse the commands then use the archive_* API which is in archive.c. That will contain all the functions needed to manipulate the archive files. It uses a ChainedList which is my rudimentary implementation of a GList-like ordered list and the archive API also uses PagedFile objects which are pretty cool. PagedFiles are a wrapper around a file which allows you to read/write to a file using pages (I set it to 64KB per page I think) so it limits the hard drive access. The cool thing about it is that it has encryption and hashing built in, so you can just set the encryption key or ask for the file to be hashed, and whenever you read/write, the encryption will be done transparently, and the coolest thing about it is that you can actually seek in the encrypted file and it will still work (it recalculates the required IV whenever you seek). The encryption there works on the stream, so you don’t need to write blocks of 16 bytes every time (thanks to the paging of the data) and it has a cool ‘splice’ method which allows you to copy data from one PagedFile to another easily, so you could in theory re-encrypt a file using a different key using 5 function calls (open *2, set_key*2, splice).

That’s about it.

I’m really happy about this release, and I want to say Merry Christmas/Happy New Year to everyone, and of course..

So long, and thanks for all the fish!

 

 

33 Responses to Ps3xport released!

  1. no0bzilla says:

    I just wanted to drop in and say thanks. i think this could, and maybe will lead to alot more interesting stuff. But thanks for everything you have done in the scene while you were learning :)

    Merry Christmas/Happy Holidays to you as well

    • Awesome release, awesome work from an awesome dev :)

      Also linking to PS3HaX isn’t a great idea, apart from the advertisements that can infect you with malware, there is also the fact they trade and sell stolen Console ID’s.

  2. Casavult says:

    Great release. And thank you for everything you have done for us.

    Happy holidays! :)

  3. majid says:

    very very thanks
    Merry Christmas/Happy New Year

  4. MovingxTarget says:

    Another amazing release by another talented dev.

    Thanks for everything. Best wishes to you and your future endeavors. :)

  5. Citra Mulia says:

    It is the greatest gift for our Christmas day this year, can not wait to try it. Merry Christmas and Happy New Year.

  6. FOKPS3 says:

    YO KAKAROTO HAPPY HOLY DAYS TO YOU AS WELL THX FOR YOU RELEASE IT SOUND LIKE ITS POSIBLE TO CREATED CFW BACK UP AND BACK THAT UP TO YOUR PS3 THEN HAVE CFW BUTT TO BAD MY PS3 HAS YELLOW LIGHT OFF DEATH AND I STILL HAVE NO FUCKING CLEU TO HOW TO USE YOUR TOOLS BE STILL THX MAN AWSOME !!!!!!!!!!!!! SORRY FOR ALLL THE CAPS JUST A LILTE EXCIDED BUT HEY STILL HAVE THE YELLOW LIGHT OFF DEATH BUT FUCK IF SOME THING BROKEN BREAK IT SOME MORE PEACE HAPPY NEW YEAR

  7. DarkPhoria says:

    You can use BRUTEFORCE to get the PSID from an OFW PS3 savedata. However, I’m not so sure if thats the case with IDPS :/

  8. Roman says:

    Заебись конечно но как выдрать эти IDPS

  9. BlackFire27 says:

    Dude this is just as dope as C4eva’s BMP Christmas release last year. Kudos, I can only fathom the work put into this.

  10. maxi says:

    Great work man, and many thanks for all your great work!
    This tool will come handy many times; loved the feature where you could seek through encrypted content! very cleaver 😉

  11. dw-tn says:

    Hi guys!

    Please tell me where to find keys.conf ?

  12. Rayes says:

    Thanks for your release and we wish you luck. :}

  13. euro ali says:

    hi kakaroto give me please keys.conf

    email: bulucu23@hotmail.com
    facebook: https://www.facebook.com/can.sonmez.103

  14. Dogertyboy says:

    Я знаю как можно запускать бекапы на офв без всяких кобр делал это уже года 2 назад до выхода ode – но есть там кое какая загвоздка … Вот если бы какарото интерфейсик выпустил бы к своему ps3xport я с уверенностью 90% запустил бекап бы на официалке ….какарото давай под старость лет сделаем подарок всей пс3 сцене ???

    • dw-tn says:

      Не хрена ты оборзел ,это и так подарок последних лет,да и ослу понятно что ты лжец…

  15. Micheal says:

    Hey Kakaroto
    Merry Chrismas and Happy New Year
    Tahnks for Your knowledge and this publication.
    I’m really happy you have courage to show it to the World :)

    I have one question:
    if i have idps from idpsstealer by flatz and backup (somewhere should be act.dat)
    do i need something else to use ReactPsn (or something similar rif2raf) to get Psn game on ofw?

  16. Rasscal says:

    Thanks for all your hardwork within the scene.
    You have been an inspiring dev, I hope you find fulfilment in your next venture.

  17. Thanks for the release, Kakaroto! However, there is a bug in your code that causes entire directories to not be dumped (because of errors creating directories), and files dumped from the backup are complete jumbles of other files mixed in.

    if you could please finish the code and re-release a windows executable that actually fully works, that’d be sweet 😀

    • kakaroto says:

      Hi,

      That’s not really a good bug report :p The code is finished and it works, I don’t know what your issues are but open an issue ticket on github and upload your archive.dat file and I’ll have a look.

      • Christopher Torrella says:

        Can you email me? I’d prefer to talk in a more private setting about the matter, especially because it involves the encrypted portion of the backup… I can show you everything from there.

  18. thx for all KaKaRoTo.. you are amazing.. wish you and your family a good time.. long life for you all..

  19. Mo says:

    The Dump command doesn’t work on windows. Always gives: “Error making directories”.

  20. […] liberou o código fonte do PS3xport no Github e postou informações sobre ele em seu blog,o PS3xport torna possível modificar backups PS3 criados com a ferramenta standard […]

  21. Axtux says:

    Thanks for this release. Hope you see this comment because I have a question. Games updates are installed into dev_hdd0/game/GAME_ID/USRDIR/EBOOT.BIN. What if we change this file with an homebrew EBOOT.BIN signed properly ? At the next boot of this game, PS3 should not launch this file ? Which checks are done ?

    Would be good to bring homebrew on PS3 without piracy.