PHPFixing
  • Privacy Policy
  • TOS
  • Ask Question
  • Contact Us
  • Home
  • PHP
  • Programming
  • SQL Injection
  • Web3.0

Thursday, April 14, 2022

[FIXED] How to fix "DocumentDB data migration tool "

 April 14, 2022     amazon-dynamodb, azure-cosmosdb, data-migration, migration     No comments   

Issue

I'm using DocumentDB data migration tool for Migration of AWS DynamoDB data to Azure CosmosDB but I'm getting an error for the large table data.

It seems DocumentDB data migration tool has a maximum capacity for data transfer is 500k bytes but I have a dynamo DB table which has data around 315 Mb. So there is any other methods/tools for data transfer from Dynamo DB to cosmos DB?

I also tried to convert the dynamo DB into JSON file and upload it to the cosmos DB collection but cosmos DB collection take max size is 2mb. In image2 showing error only for large data file while I tried for the file less than the size of 500k bytes, it worked properly.

Preview stage

X

Error image

Y


Solution

As I had around 40 GB of data in dyanamo DB and wanted to move it to Cosmos DB. But cosmos DB has some limitation that while direct copying will won't allow json data size more than 2 mb.

I used same tool and coverted the DynamoDB data into json format and store on server, once it is completed i uploaded that json data to cosmos DB using same DocumentDB Data Migration Tool.

Thanks for your responses.



Answered By - vishalsingh1347
Answer Checked By - Marilyn (PHPFixing Volunteer)
  • Share This:  
  •  Facebook
  •  Twitter
  •  Stumble
  •  Digg
Newer Post Older Post Home

0 Comments:

Post a Comment

Note: Only a member of this blog may post a comment.

Total Pageviews

Featured Post

Why Learn PHP Programming

Why Learn PHP Programming A widely-used open source scripting language PHP is one of the most popular programming languages in the world. It...

Subscribe To

Posts
Atom
Posts
Comments
Atom
Comments

Copyright © PHPFixing