How do I improve the speed of the dynamodump import to the target Dynamo DB?

[cvsudheer108]

Hello,
I have exported data from the source DynamoDB on to a AWS EC2 machine (t3.small) and then trying to import the data to the target Dynamo DB.
I see that it is taking time (1 min for 1 MB ), which might be too much when I add on all my table data.
Is there a way to improve the speed of import?
I see that there I an option to mention the throughput in : dynamodump wipe-data --throughput, but not for was import-data.
Please let me know.

[cvsudheer108]

I need to migrate the data from one prod account to another and hence can't afford much down time... please advise..

[cvsudheer108]

1.dynamodata 5MB 1.5 min
2.dynamodata 12MB 7 min
3.dynamodata 32MB 25 min
I see the speed reduces as the size of the file increases..

[Lusitaniae]

https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/backuprestore_HowItWorks.html

…

On Tue, 28 Jun 2022 at 12:31 Sudheer Kumar ***@***.***> wrote: 1.dynamodata 5MB 1.5 min 2.dynamodata 12MB 7 min 3.dynamodata 32MB 25 min I see the speed reduces as the size of the file increases.. — Reply to this email directly, view it on GitHub <#28 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAAOHVJGLWGLOPG36OPCOHLVRKE2BANCNFSM5Z7KR7OQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[cvsudheer108]

I have resolved the issue usign the AWS Backup service. They have a new feature that enables cross account and cross region back-up of Dynamo DB tables. The current Dynamo DB replication supports only the cross-region feature, but not corss account. This video talks about AWS backup settings in detail : https://www.youtube.com/watch?v=dCy7ixko3tE
For DDB backup, we need to enable the following in AWS Backup -> Settings:

1. Advanced features for Amazon DynamoDB backups - Enable
2. Cross account-management->Cross-account backup - Enable

[mifi]

hi. there should be the --throughput flag for import also. Does it not work?

dynamodump/cli.js

Line 290 in 0930580

const throughput = getThroughput(1);

[mifi]

I think it needs to rewritten to use aws-sdk-v3 instead, like I just did with cognito-backup: mifi/cognito-backup@431e707