Skip to content

Commit

Permalink
Add documentation structure
Browse files Browse the repository at this point in the history
  • Loading branch information
julienrf committed Jun 26, 2024
1 parent 6dec14d commit 995a019
Show file tree
Hide file tree
Showing 12 changed files with 57 additions and 8 deletions.
2 changes: 1 addition & 1 deletion docs/source/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -109,7 +109,7 @@
"hide_feedback_buttons": "false",
"github_issues_repository": "scylladb/scylla-migrator",
"github_repository": "scylladb/scylla-migrator",
"site_description": "Migrate data extract using Spark to Scylla, normally from Cassandra.",
"site_description": "Migrate data using Spark from Cassandra or DynamoDB to Scylla.",
"hide_version_dropdown": [],
"zendesk_tag": "",
"versions_unstable": UNSTABLE_VERSIONS,
Expand Down
3 changes: 3 additions & 0 deletions docs/source/getting-started/ansible.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
===================================
Set Up a Spark Cluster with Ansible
===================================
4 changes: 4 additions & 0 deletions docs/source/getting-started/aws-emr.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
===================================
Set Up a Spark Cluster with AWS EMR
===================================

10 changes: 10 additions & 0 deletions docs/source/getting-started/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
===============
Getting Started
===============

.. toctree::
:hidden:

ansible
aws-emr
spark-standalone
4 changes: 4 additions & 0 deletions docs/source/getting-started/spark-standalone.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
================================
Manual Set Up of a Spark Cluster
================================

16 changes: 14 additions & 2 deletions docs/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,21 @@
ScyllaDB Migrator Documentation
===============================

Migrate data extract using Spark to Scylla, normally from Cassandra.
The Scylla Migrator is a Spark application that migrates data to ScyllaDB. Its main features are the following:

* it can read from Cassandra, Parquet, DynamoDB, or a DynamoDB S3 export
* it can be distributed over multiple nodes of a Spark cluster to scale with your database cluster
* it can rename columns along the way
* it can transfer a snapshot of the source data, or continuously migrate new data as they come

Read over the :doc:`Getting Started </getting-started/index>` page to set up a Spark cluster for a migration.

.. toctree::
:hidden:

sample-page
getting-started/index
migrate-from-cassandra-or-parquet
migrate-from-dynamodb
stream-changes
rename-columns
validate
5 changes: 5 additions & 0 deletions docs/source/migrate-from-cassandra-or-parquet.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
=================================
Migrate from Cassandra or Parquet
=================================


5 changes: 5 additions & 0 deletions docs/source/migrate-from-dynamodb.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
=====================
Migrate from DynamoDB
=====================


5 changes: 5 additions & 0 deletions docs/source/rename-columns.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
==============
Rename Columns
==============


5 changes: 0 additions & 5 deletions docs/source/sample-page.rst

This file was deleted.

3 changes: 3 additions & 0 deletions docs/source/stream-changes.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
==============
Stream Changes
==============
3 changes: 3 additions & 0 deletions docs/source/validate.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
======================
Validate the Migration
======================

0 comments on commit 995a019

Please sign in to comment.