qsfs tutorial

[xmonader]

https://git.ourworld.tf/tfgrid/circle_engineering/issues/23

• how to setup
• how to connect to created ZDB's using TFCMD
• how to mount QSFS
• vscript example to setup a filesystem using ZDB's all in UBuntu 23.10 using vlang vscript
• how to see see monitoring/health
• check that we can repair, how can we see we need repair
• check that we can re-connect on other VM
• make a test script where we destroy a VM which was writing to QSFS, then create new VM which remounts QSFS, there might be some data lost, but never longer than e.g. 15 min
• check that all metadata is there as needed to reconnect, document where metadata is
• explain architecture and how we use local ZDB as cache

repo:

• https://github.com/threefoldtech/quantum-storage

Testsuite to be reviewed:

• https://app.testlodge.com/a/26076/projects/40893/suites/195671

[ramezsaeed]

@LeeSmet
can you please update us here by what is implemented and what is not yet so we can start testning, and @Mik-TF can start doing the Docs for that.

[ramezsaeed]

Currently we have this tutorial:
https://manual.grid.tf/documentation/system_administrators/terraform/resources/terraform_qsfs.html

[A-Harby]

What I found so far:

• For terraform:
  • The docs.
  • The example, but it needs to be updated to work fine, and I reported it here but I was able to get the code to work in the end.
• For TS client:
  • The docs.
  • The example.

Update:

• Found script for QSFS in the Go client, but it is written as a test.
• Didn't find way to deploy in tfcmd and no docs for it.

[Mik-TF]

Great! Thanks for this research and testing.

With terraform, you got it to work finally? If yes can you share the files you used? Thanks.

[A-Harby]

Update:

• Found script for QSFS in the Go client, but it is written as a test.
• Didn't find way to deploy in tfcmd and no docs for it.

I created an issue threefoldtech/tfgrid-sdk-go#1103 to add a way to deploy QSFS in TFCMD.

[ramezsaeed]

@LeeSmet
can you please check this one as its important for @Mik-TF to complete the manual.

threefoldtech/quantum-storage#38

[A-Harby]

I created this issue (threefoldtech/quantum-storage#39) to create a bash script to make the installation easier for the user.

And I am still trying to get qsfs to work following these two files: https://github.com/threefoldtech/info_grid/pull/588/files and https://github.com/threefoldfoundation/info_threefold_pub/blob/main/wiki/qss/manual/qsfs_setup.md.

[Mik-TF]

Scott has some work done on info_grid. It might be of use. threefoldtech/info_grid#588

[A-Harby]

Updates:

I have reviewed the PR and found some comments on the quantum_safe_storage_deploy.md file that need to be fixed or to have more explanation. threefoldtech/info_grid#588.

And I have also followed all the steps to deploy QSFS, but I am still failing to get it to work and am still debugging.

root@vmjlr69:~# zstor --log_file ~/zstor.log -c /etc/zstor-default.toml status
Error: ZstorError { kind: Config, internal: Other(Error { inner: ErrorInner { kind: Wanted { expected: "a right bracket", found: "an identifier" }, line: Some(28), col: 19, at: Some(586), message: "", key: [] } }) }

[A-Harby]

I have added some more comments to the PR.

And I created some issues that I found:

• Used space isn't changing quantum-storage#40
• ZDB status not stable with Yggdrasil 0-db#167
• 🐞 [Bug]: ZDB metadata is wrong  tfgrid-sdk-go#1128
• Cache flush doesn't work quantum-storage#41.

[Mik-TF]

Amazing @A-Harby, you're on fire! Will check the info_grid PR with Scott. Thanks.

[A-Harby]

Updates:
I created a new issue for the cache: threefoldtech/quantum-storage#41.

All of the tests can't be done until all of the issues are resolved. #1539 (comment).

And I am still waiting for the fixes in the PR https://github.com/threefoldtech/info_grid/pull/588/files#diff-b0d52cfbe1929e80b61aa5d44f601ec5487d3ec6e5cf228cad7ed7af47aeea97 to check docs boxes.

[A-Harby]

• how to setup
• how to connect to created ZDB's using TFCMD

• how to mount QSFS
• check that all metadata is there as needed to reconnect, document where metadata is
• explain architecture and how we use local ZDB as cache
• how to see see monitoring/health
• check that we can repair, how can we see we need repair
• check that we can re-connect on other VM

These should be covered here PR.

• make a test script where we destroy a VM which was writing to QSFS, then create new VM which remounts QSFS, there might be some data lost, but never longer than e.g. 15 min

This test and test suite will be created after the issues are solved. #1539 (comment).

• vscript example to setup a filesystem using ZDB's all in UBuntu 23.10 using vlang vscript

There is no possible, clear way to do that yet.

[A-Harby]

Blocked on #1539 (comment), and @scottyeager confirmed the issue threefoldtech/quantum-storage#41, and he also found another bug threefoldtech/0-stor_v2#122.