Many, Many people have asked me if there was an easy way to get the Prosper XML files as CSV (comma separated values). In response, I have build a utility that does just that. I contributed the utility to the Prosper API Open Source Project on SourceForge.
With CSV files you can easily import the files into older versions of MS Access (with access 2007 you can import the xml directly) and various statistics packages (SASS, MatLab). I tried to make the utility extremely easy to use. In that spirit I have also built a single JAR file, which you can download here: ProsperXMLtoCSV.jar. By using the single JAR you do not need to worry about your class path and various other java idiosyncrasies.
Please note that these CSV files are larger than can be opened in Excel. If you do open with excel some rows will be missing.
There are 2 ways to run the jar; however, only one way provides you with feedback during the long process of parsing the XML files and producing the CSV files. So I will only tell you how to run the jar with feedback.
With java 5 or better installed and in your path use the following command line from the directory containing the ProsperXMLtoCSV.jar file…
java -jar ProsperXMLtoCSV.jar ProsperXMLFileLocation CSVDestinationDirectory
- Prosper XML File Location: this is either the relative or fully qualified path to the Prosper XML file you are trying to parse
- CSV Destination Directory: optional (if left off the current directory will be used) this is either the relative or fully qualified path to the destination directory for the CSV files
When you run this file you are given an output similar to this (this output was for the private data file)…
C:\prosperapi\trunk\data>java -jar ProsperXMLtoCSV.jar ProsperDataPrivateExpor
xml .
Starting conversion of CreditProfiles
CreditProfiles rows converted: 10000
CreditProfiles rows converted: 20000
CreditProfiles rows converted: 30000
CreditProfiles rows converted: 40000
CreditProfiles rows converted: 50000
CreditProfiles rows converted: 60000
CreditProfiles rows converted: 70000
CreditProfiles rows converted: 80000
CreditProfiles rows converted: 90000
CreditProfiles rows converted: 100000
CreditProfiles rows converted: 110000
CreditProfiles rows converted: 120000
CreditProfiles rows converted: 130000
CreditProfiles rows converted: 140000
CreditProfiles rows converted: 150000
CreditProfiles rows converted: 160000
CreditProfiles rows converted: 170000
CreditProfiles rows converted: 180000
CreditProfiles rows converted: 190000
CreditProfiles rows converted: 200000
CreditProfiles rows converted: 210000
CreditProfiles rows converted: 220000
ProsperDataExport rows converted: 221166
Starting conversion of LoanPerformances
LoanPerformances rows converted: 10000
LoanPerformances rows converted: 20000
LoanPerformances rows converted: 30000
LoanPerformances rows converted: 40000
LoanPerformances rows converted: 50000
LoanPerformances rows converted: 60000
LoanPerformances rows converted: 70000
LoanPerformances rows converted: 80000
LoanPerformances rows converted: 90000
LoanPerformances rows converted: 100000
LoanPerformances rows converted: 110000
LoanPerformances rows converted: 120000
LoanPerformances rows converted: 130000
LoanPerformances rows converted: 140000
LoanPerformances rows converted: 150000
LoanPerformances rows converted: 160000
LoanPerformances rows converted: 170000
LoanPerformances rows converted: 180000
LoanPerformances rows converted: 190000
LoanPerformances rows converted: 200000
LoanPerformances rows converted: 210000
LoanPerformances rows converted: 220000
LoanPerformances rows converted: 230000
LoanPerformances rows converted: 240000
LoanPerformances rows converted: 250000
ProsperDataExport rows converted: 257224
If you like this utility consider supporting future open source development with a donation via paypal:
Related Posts -
Prosper Debt Sale Offer Roughly 0.93%-4.83% On Friday, Doug Fuller gave an update on the debt sale. Synopsis:Â Prosper put the bid file on an auction site, 8 bids received, all the bids were very disappointing, Prosper has not accepted a bid yet, and is exploring options for getting a better deal. When asked how disappointing...... -
Everyday People -- Shining Example of Prosper Group Here is a current listing from EveryDay People. This listing has an excellent chance of funding. In addition, Everyday People's Group Leader StaciM has also endorsed AND BID on the listing. (Personally I think an endorsement without a bid is meaningless... kudos StaciM). The reason StaciM can bid with confidence...... - Prosper Debt Sale In Progress As I mentioned several days ago a debt sale is about to be completed. I have had 3 loans sold so far (I will update this page if more are sold)... B Credit @15.16% interest rate, non-homeowner, sold for 9.54% of principal (borrower had not made a single payment). C......
-
Daily Late 0 DQ Vintage Curves You may have seen my Prosper vintage curves... While they were hard to make since the data had to be pulled off the Prosper Loan Performance page. These are now much easier with the private lender data (see the sql at the end of the post for those that are...... -
LendingClub Goes National -- Lending Club Data LendingClub CEO Renaud Laplanche announced today via the LendingClub Blog that Lending Club is Going National. Lending Club launched on Facebook just 6 months ago and opened their public website 3 months ago. By going national they are able to lend to 108 million more American than yesterday. The states......
Related Websites -
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_b.png?x-id=ed184035-8325-46df-9cb2-05553f9f59d0 "Reblog this post [with Zemanta]")
Perl script to create csv files with a pattern - Generic script. I was having a really bad day and needed a quick solution to create some csv files. And this I needed to do for multiple data kinds and patterns, so I created this small script to do the job for me... #Number of rows required in the output. $rows...... -
Powerball Australia Results file Powerball Results Australia - latest and all historical results can be viewed here: POWERBALL Results Powerball has a guaranteed minimum jackpot of $3million, but can go as high as $100million+. The draw is composed of 5 balls chosen from a barrel of 45 balls, and 1 Powerball taken from another barrel...... - TODO: sorting by Covey's and Blanchard's Quadrants Which items on a todo list are important? Which are unimportant? Which should be done first, and which can be postponed for later (or never perhaps). The problem with listing todo items in simple order of priority, let's say 1, 2, 3 and 4 where "1" is highest priority......
- Fun with sed --- Date format conversion between Excel and SQL [Updated March 9, 2009: Added the code listing to show how the regular expression is used.] Here is a little regular expression that will convert m/d/y dates from Excel spreadsheets into y/m/d dates used by SQL. Why I can't export in this format from the Excel spreadsheet is a mystery.......
- Top Free Online YouTube Converters Do you want to convert YouTube videos to MP3, animated gif images or different video formats but you don't how? Maybe some people already know about this, but i just want to highlight again to people who don't know about it. For those who already knew about this sites and......
- Open Salts Tableware Housewares Kitchenware Collectibles
- Path Lighting Outdoor Lighting Yard, Garden Outdoor Living
- X-Files Sci-Fi, Fantasy Trading Cards Collectibles
- Utility Black Glass Antique Pre-1900 Bottles Bottles Insulators Collectibles
- X-Files Science Fiction Collectibles
Categories:
9 comments ↓
Thanks for the contribution Kevin!
[...] RateLadder built a tool to Convert Prosper XML to CSV [...]
This is fantastic, thanks!
I am glad you like it.
I clicked on the link above for the “single jar file” and it downloads a zip archive. There are no files in the archive called ProsperXMLtoCSV.jar
There is something called main.jar, but I get errors when I run that.
I don’t speak java, and I just want to get either CSV files, or this loaded into SQL Server without me having to write any java or VB. Please help.
The jar file itself is runnable… Assuming you have java installed. Jar is just a special zip file. Meaning that a jar is a file in the zip format, but the a java enabled environment jars can be run. This particular jar is special in that I compiled everything needed to run it into a single file eliminating possible class path issues.
Like Jeff, I am also confused as to how to follow the instructions above. Can someone please assist?
You write:
“With java 5 or better installed…”
- I am running Java 6.7
“…and in your path…”
- I don’t know what is meant by this exactly
“…use the following command line from the directory containing the ProsperXMLtoCSV.jar file…”
- As Jeff notes above, there are no files in the zipped archive by that file name
“…java -jar ProsperXMLtoCSV.jar ProsperXMLFileLocation CSVDestinationDirectory”
- I’m not clear about where to enter this command
This would be an incredibly helpful utility if I can get it working. Thanks in advance for your assistance.
the link in the post to to a file name “ProsperXMLtoCSV.jar” that file is whole and does not need to be unzipped. It will run from a command line if everything is properly configured as stated in this post.
Ok, for those of you still having trouble, here are some additional instructions for how to run this conversion:
1. You must save the above ProsperXMLtoCSV.jar link to your computer as a *.jar file, NOT as a *.zip file. Right-click on the link and select “Save target as…” to accomplish this.
2. You must start with an open Command Prompt. From Windows, go to Start\Programs\Accessories and select Command Prompt. The user interface should look like MS DOS.
3. You must run the above Java command as indicated from the directory into which you have saved the *.jar file. It is helpful to save the *.jar file in the same directory as your Prosper *.xml file(s).
4. Within the Java command, “ProsperXMLFileLocation” is the actual name of your *.xml file that you want to convert. If you are running the command from the same directory that your file is located in, you can just type the name of the file with the *.xml extension included.
Hope this helps.
Leave a Comment