P2P Lending -- News, Information, Borrowing and Lending Strategy


Import Prosper.com Listing, Loan, Group, Member Data into Microsoft Sql Server 2000

Prosper.com makes all publicly available data accessible via a data export.  They also provide tools for importing that data into Microsoft Sql Server 2005.  What they don’t provide is a mechanisms for getting this data into other databases, specifically in my case Microsoft Sql Server 2000.  I have succeeded in importing the data into a Sql Server 2000 database and I am sharing that information with the world.

One of the main problems with importing the data directly into Sql Server 2000 is the row size of the data in the export.  Sql Server 2000 has a limit of 8060 bytes per row.  At least one row in the export is larger, but I expect there are quite a few.  While I was examining the data model I noticed 2 columns in several tables that I really don’t care about: description and images.   I say I don’t care about them because for my purposes I just care about credit and interest rate (I expect that most people are the same) and if I care that information is available by looking on Prosper.com since I have the primary key.  So that being said, my technique requires removing those columns from the import.  I have provided all the needed files so for others this wont be very difficult.

 Step 1: Download the data from Prosper.com here ProsperDataExport_xml.zip and unzip to a new directory

Step 2: Download the following zip archive and unzip into a new directory: Files required to import Prosper.com data into Sql Server 2000

Step 3: Create a Database (I named mine Propser).  Run the sql script ProsperDataExport_CreateTables.sql from the RateLadder.com download.

Step 4: If you don’t already have SqlXml 3.0 by Microsoft click the link to download and install.

Step 5: Replace ProsperDataExport.xsd with the RateLadder.com version.

Step 6: In Enterprise Manager create a DTS package.  Add an ActiveX Task.  Use the code in the file ActiveXTask.txt as the code for the new task.  Please be sure to replace the file locations and database name in the code with your file locations and database name.

Step 7: Execute the Task.

Viola!

If you found this helpful and you would like to donate to show your appreciation please feel free to do so.  Thanks, RateLadder.com



Useful Info:

comments

Leave a Reply




Prosper America's Leading Online Lending Marketplace

Financial Web - The Independent Financial Portal
Need a loan before payday? Trying hard to settle debt? Get back on track, learn all about consolidating your debt and find out where to get credit cards for bad credit.