How can we upload huge data sets say 1 lakh records to kinvey database

1) using the client library and adding each record one by one to the collection?

2) is there a way other than importing csv file through kinvey console?

Thanks

HI,

Any Update on this..

Hi,

Thank you for choosing Kinvey as your choice of mBaaS. And sorry about the delay in responding. I missed it probably because it was put under Java category.

To answer your questions:

1. This is obviously possible, but it would time consuming.
2. You can import CSV file using Kinvey Console. Once you create a collection, you can go to settings tab and Choose "Import" option to upload a CSV file.

Hello Ram,

I have some additional questions. When you say "lakh" do you mean 100,000 bytes, records, individual data sets, files? 

Also, if the answer is individual data sets, what are the size of those data sets. If they are not fixed, do you have an average?

What is the format of your data sets?

Once updated, will you be added to the data over time or will this be a fixed amount of data that your application will retrieve? Or is it both?

Regards,

Billy

Kinvey Support

Thanks Wani, Billy for your reply.

We are in DEV Week now and the application is new one. We are loading data records into kinvey by pre-fetching third party apis, csv data files. We will save application specific data into kinvey collection. For the process of pre-fetching the data to kinvey we thought of having a process which will hit the third party api and saves to kinvey(by using update collection api) in a scheduled way. So if there are 1 lakh records, process will make 1 lakh service calls to kinvey. Is it the better way to do this or any good approach available?.