-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ACQ-ID New Floppy and Iomega tranfer pages #92
Merged
Merged
Changes from all commits
Commits
Show all changes
15 commits
Select commit
Hold shift + click to select a range
3781d00
added before imaging boiler plate. started changes to completing a tr…
dreyjo 3df9755
adjusted deprecated albels on floppy disks, added boilerplate to iome…
dreyjo 4e70d35
added sketch of pyhton script, light copyediting, added note for call…
dreyjo 5bb2525
light copyediting
dreyjo cd5e4e7
added sketch of pyhton script, light copyediting, added note for call…
dreyjo ac5243a
added package_images instructions
dreyjo 90c5d05
added package_images record to working scripts
dreyjo ae0a415
added working scripts link for package_images to floppy disk transfer…
dreyjo be7aeef
Callout config and transfer pages
arhonemus 2966b82
added deprecated callout to config
arhonemus d20a26f
added instructions for callouts
nkrabben c66daf9
added deprecated callout to floppy xfr
dreyjo d0b2672
editing callouts and package_images.py instructions
dreyjo efd1039
edited floppy, iomega, and package_image.py tool record to reflect th…
dreyjo 94bd136
incorporating review suggestions
dreyjo File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,6 @@ | ||
name,desc,use | ||
makesips (SIPdir.sh),This bash script is used by Digital Archives staff to create consecutive numbers of submission information packages for material transferred from digital carriers., Navigate to collection directory in diskImages and run ```makesips``` in terminal. Follow script instructions to select collection number type and enter collection number and submission information package range. | ||
movekflux (kryofluxmove.sh),This bash script is used by Digital Archives staff to move floppy disk images transferred using kryoflux to submission information packages.,Navigate to kryofluxOutput and run ```movekflux``` in terminal. Follow the script instructions to enter collection number and move floppy disk images. | ||
package_images.py, This python script creates archival information packages based on a given acquisition id and moves related files from a transfer diretory into the associated packages in a destination directory. This script is primarily used in the imaging process for floppy and Iomega zip disks., The script takes three arguments: ```--acqid``` for acquisiton id in the syntax ACQ-####. ```--source``` for the path to directory holding images to be packaged. ```--dest``` for the path to destination directory for package. | ||
report_ftk_extents.py,This python script transforms XML reports exported from FTK after Processing Archivists have completed bookmarking into JSON files for import into ASpace.,The script takes two arguments: ```-f``` or ```--file``` followed by the path to the XML report to be transformed and ```-o``` or ```--output``` followed by the path the destination directory for JSON output. | ||
report_HDD_extents.py,This python script collects the extents of finding aid components created by a Processing Archivist when processing work is done at a workstation with a hard drive. The script then produces an extents JSON file for import into ASpace.,The script takes one argument: ```-d``` or ```--dir``` for the finding aid components directory on a hard drive.<br> Run the script following the syntax: ```python3 path/to/report_ftk_extents.py -d /path/to/collection/er/directory``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change | ||||
---|---|---|---|---|---|---|
|
@@ -5,23 +5,29 @@ nav_order: 5 | |||||
parent: Transfers | ||||||
--- | ||||||
|
||||||
# Floppy Disks | ||||||
# Floppy Disks | ||||||
|
||||||
**Before a media object can be imaged it first must be recorded SPEC.** | ||||||
This page describes instructions for imaging floppy disks using the KryoFlux microcontroller and software. For more detailed installation and use information see the [Kryoflux documentation](https://nypl.github.io/digarch/tools/kryoflux) in our Tools section. | ||||||
|
||||||
## Getting set up | ||||||
### Before Imaging | ||||||
{: .important } | ||||||
Before any media can be imaged **it first must have an object record in SPEC**. | ||||||
* Verify a tracking card exists on Trello for the associated acquisition being imaged | ||||||
* Create a card if it does not already exist | ||||||
* See our [Preparing for Transfer](https://nypl.github.io/digarch/transfers/preparing-for-transfer.html) page for detailed pre-imaging and transfer instructions. | ||||||
|
||||||
### Connect the KryoFlux | ||||||
|
||||||
* Ensure the floppy drive is correctly connected to the Kryoflux. | ||||||
* Attach the KryoFlux USB cable from the forensic workstation to the Kryoflux board. | ||||||
* See a green power light glow on the Kryoflux board. | ||||||
* Attach the AC power cable to the power supply. | ||||||
* See the green LED on the power supply light up. | ||||||
* Listen for a faint click from the disk drive. | ||||||
|
||||||
**See the [KryoFlux page in the Tools section for more](https://nypl.github.io/digarch/tools/kryoflux).** | ||||||
* Listen for a faint click from the disk drive. | ||||||
|
||||||
|
||||||
### Calibrate the KryoFlux | ||||||
|
||||||
* Open the KryoFlux software from the desktop "kryoflux-ui.jar". | ||||||
* Click on the drive menu and ensure that ‘Drive 0’ is selected. | ||||||
* Select ‘calibrate’ from the drive menu, then ‘yes’ from the pop-up window. | ||||||
|
@@ -30,7 +36,8 @@ parent: Transfers | |||||
* Calibrate only once when you begin a session, unless calibration fails. | ||||||
|
||||||
### Resolve communication with the drive. | ||||||
Follow these steps if the KryoFlux is unable to communicate with the drive. | ||||||
|
||||||
Follow these steps if the KryoFlux is unable to communicate with the drive: | ||||||
* Close the application. | ||||||
* Disconnect the power source from the drive. | ||||||
* Disconnect the USB cable from the KryoFlux board. | ||||||
|
@@ -55,10 +62,12 @@ Follow these steps if the KryoFlux is unable to communicate with the drive. | |||||
* Select “Multiple” from the drop-down below the "Enter name ..." text field when you have determined the correct sector format. | ||||||
* Select “KryoFlux stream image” and, while holding down the control key, select the correct sector format from the dropdown. | ||||||
* Select ‘ok’ to close the popup. | ||||||
* Click the start button to begin the imaging process. | ||||||
The KryoFlux will now create a folder with the name of the id of the media that contains the stream image files and a sector image (again with the name of the media plus an “.001” file extension). Both the stream directory and the sector image file will be written to the kryofluxOutput directory on Staging. | ||||||
* Click the start button to begin the imaging process. | ||||||
|
||||||
The KryoFlux will now create a folder with the name of the id of the media that contains the stream image files and a sector image (again with the name of the media plus an “.001” file extension). Both the stream directory and the sector image file will be written to the kryofluxOutput directory on Staging. | ||||||
|
||||||
### Tracking | ||||||
|
||||||
* Navigate to the [Tracking](https://drive.google.com/drive/folders/1tv4nr9Nq_c8wkqPpz_eQX7NKRRrlEisp?usp=share_link){:target="_blank"} folder in Google Drive. | ||||||
* Find the spreadsheet for the acquisition that you will be working with. | ||||||
* Copy [Tracking_TEMPLATE](https://docs.google.com/spreadsheets/d/1TwWMsrCf2hf5LzdtA6EG-2wcgFW_Uz750x-PZtFop90/edit?usp=sharing) to create a spreadsheet if one doesn't exist. | ||||||
|
@@ -106,10 +115,23 @@ Follow these steps if the KryoFlux is unable to communicate with the drive. | |||||
| -- | | ||||||
| Y | | ||||||
|
||||||
### Package Images with package_images.py | ||||||
|
||||||
The python script package_images.py identifies digital carrier images in an input directory, creates a archival information package, and moves image files into the package. This section describes packaging with package_images.py for floppy and Iomega disks. For detailed information on installation and use see the [package_image.py](https://nypl.github.io/digarch/tools/working-scripts.html#package_imagespy) listing in the Working Scripts section of our documentation. | ||||||
|
||||||
Use package_images.py with the followings steps: | ||||||
* Open Terminal | ||||||
* Enter the following command with the appropriate paths: ```python3 package_images.py –-acqid (M#### or ACQ_####) -–source path/to/images -–dest path/to/diskImages``` | ||||||
* Navigate to destination directory to verify packages have been created and image files have been moved | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
### Completing the imaging process | ||||||
|
||||||
* Put the media back in the collection’s box and move or remove the pink “To image” flag as necessary if you are working on a large collection. | ||||||
* Move the media to the “Small collections complete” box if you are working on a small collection without a box. | ||||||
* Return media to the collection’s box or move media to the "Small Collections Transferred" box if you are working on a small collection without a box. | ||||||
* Update object record migration status in SPEC. See [Updating records in SPEC](https://nypl.github.io/digarch/transfers/Completing-transfer.html#updating-records-in-spec) section on Completing a Transfer page for detailed instructions | ||||||
|
||||||
|
||||||
{: .deprecated} | ||||||
The following sections describe imaging and packaging processes no longer regularly used. Consult these sections when working with legacy collections requires understanding previously done work. | ||||||
|
||||||
### Using Digital Archives scripts | ||||||
Make sure the setup instructions for Digital Archives [scripts](https://github.com/NYPL/digarch_scripts){:target="_blank"} have been completed before running the scripts in the next section. | ||||||
|
@@ -175,7 +197,6 @@ Or | |||||
* /objects | ||||||
|
||||||
### Package images | ||||||
|
||||||
On Mac: | ||||||
|
||||||
* Open Terminal. | ||||||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -6,78 +6,14 @@ parent: Transfers | |
--- | ||
|
||
## Iomega Disks | ||
This page covers Iomega disk imaging with the FTK Imager software. Iomega disks are usually imaged with FTK Imager. Use FTK Imager when creating a disk image of a hard drive or removable media. | ||
|
||
**Before a media object can be imaged it first must be recorded SPEC.** | ||
|
||
This section covers imaging with FTK Imager. Iomega disks are usually imaged with FTK Imager. Use FTK Imager when creating a disk image of a hard drive or removable media. | ||
|
||
### Using Digital Archives scripts | ||
Make sure the setup instructions for Digital Archives [scripts](https://github.com/NYPL/digarch_scripts){:target="_blank"} have been completed before running the scripts in the next section. | ||
|
||
### Create destination directories | ||
|
||
**These instructions show you how to create destination directories for a number of consecutive disks. Consider using a one-line command to create directories if the disks you are packaging do not have consecutive MediaID numbers.** | ||
|
||
On Mac: | ||
|
||
* Open Terminal. | ||
|
||
* Navigate to DigArchDiskStation. | ||
|
||
* Change into diskImages directory. | ||
```$ cd /Volumes/DigArchDiskStation/Staging/ingest/diskImages``` | ||
|
||
* Create a directory for your collection if it does not exist. | ||
```$ mkdir ACQ_acqID``` | ||
|
||
* Change into your collection directory. | ||
```$ cd ACQ_acqID``` | ||
|
||
* Run [makesips script](https://nypl.github.io/digarch/tools/working-scripts.html#makesips-sipdirsh){:target="_blank"} to create a consecutive number of submission information packages for material from digital media. | ||
|
||
Or | ||
|
||
* Change to diskImages directory. | ||
|
||
```$ cd /Volumes/DigArchDiskStation/Staging/ingest/diskImages``` | ||
* Enter ```mkdir``` command. | ||
```mkdir -p ACQ_acqID/ACQ_acqID_specObjectID/{metadata,objects}``` | ||
|
||
On Windows via WSL: | ||
|
||
* Open WSL. | ||
* If you do not see the Y:\ drive in /mnt or /mnt/y appears to be empty then it must be re-mounted by: | ||
* Changing to the top level directory by entering ```cd ../``` | ||
* Entering the command ```sudo mount drvfs Y: /mnt/y``` | ||
* Change into diskImages directory. | ||
```$ cd /mnt/y/Staging/ingest/diskImages``` | ||
|
||
* Create a directory for the acquisition if it does not exist. | ||
```$ mkdir ACQ_acqID``` | ||
|
||
* Change into the acquisition directory. | ||
```$ cd ACQ_acqID``` | ||
|
||
* Run [makesips script](https://nypl.github.io/digarch/tools/working-scripts.html#makesips-sipdirsh){:target="_blank"} to create a consecutive number of submission information packages for material from digital media. | ||
|
||
Or | ||
|
||
* Change to diskImages directory. | ||
|
||
```$ cd /mnt/y/Staging/ingest/diskImages``` | ||
* Enter ```mkdir``` command. | ||
```mkdir -p ACQ_acqID/ACQ_acqID_specObjectID/{metadata,objects}``` | ||
|
||
#### Directory structure | ||
|
||
* /M2319-0021 | ||
* /metadata | ||
* | ||
* /objects | ||
|
||
|
||
<!-- ![](media/media/image29.png){width="6.069444444444445in" | ||
height="2.3472222222222223in"} --> | ||
### Before Imaging | ||
{: .important } | ||
Before any media can be imaged **it first must have an object record in SPEC**. | ||
* Verify a tracking card exists on Trello for the associated acquisition being imaged | ||
* Create a card if it does not already exist | ||
* See our [Preparing for Transfer](https://nypl.github.io/digarch/transfers/preparing-for-transfer.html) page for detailed pre-imaging and transfer instructions. | ||
|
||
### Image disks | ||
|
||
|
@@ -185,22 +121,88 @@ height="4.55in"} --> | |
| -- | | ||
| Y | | ||
|
||
### Package Images with package_images.py | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Align Package Images instructions for Floppy and Iomega |
||
|
||
The python script package_images.py identifies digital carrier images in an input directory, creates a archival information package, and moves image files into the package. This section describes packaging with package_images.py for floppy and Iomega disks. For detailed information on installation and use see the [package_image.py](https://nypl.github.io/digarch/tools/working-scripts.html#package_imagespy) listing in the Working Scripts section of our documentation. | ||
|
||
Use package_images.py with the followings steps: | ||
* Open Terminal | ||
* Enter the following command with the appropriate paths: ```python3 package_images.py –-acqid (M#### or ACQ_####) -–source path/to/images -–dest path/to/diskImages``` | ||
* Navigate to destination directory to verify packages have been created and image files have been moved | ||
|
||
### Completing the imaging process | ||
|
||
* Put the media back in the collection’s box and move or remove the pink “To image” flag as necessary if you are working on a large collection. | ||
* Move the media to the “Small collections complete” box if you are working on a small collection without a box. | ||
|
||
### Metadata | ||
Deprecated | ||
{: .label .label-red } | ||
* Open Cygwin and enter the following commands: | ||
* Connect to ARCHV Mac. | ||
```$ ssh archv``` | ||
* Change to the diskImages directory and change directory to the objects folder for the media object. | ||
`$ diskimages` | ||
`$cd ACQ_acqID/ACQ_acqID_specObjectID/objects` | ||
* Run disktype on the disk image to get the file system metadata. | ||
`$ disktype ACQ_acqID_specObjectID.E01` | ||
* Copy the file system information data into the media objects CMS record. | ||
* Run program to move metadata files to metadata directory. | ||
`$ movemetadata` | ||
* Return media to the collection’s box or move media to the "Small Collections Transferred" box if you are working on a small collection without a box. | ||
* Update object record migration status in SPEC. See [Updating records in SPEC](https://nypl.github.io/digarch/transfers/Completing-transfer.html#updating-records-in-spec) section on Completing a Transfer page for detailed instructions | ||
|
||
|
||
{: .deprecated } | ||
The following sections describe imaging and packaging processes no longer regularly used. Consult these sections when working with legacy collections requires understanding previously done work. | ||
|
||
### Using Digital Archives scripts | ||
Make sure the setup instructions for Digital Archives [scripts](https://github.com/NYPL/digarch_scripts){:target="_blank"} have been completed before running the scripts in the next section. | ||
|
||
### Create destination directories | ||
|
||
**These instructions show you how to create destination directories for a number of consecutive disks. Consider using a one-line command to create directories if the disks you are packaging do not have consecutive MediaID numbers.** | ||
|
||
On Mac: | ||
|
||
* Open Terminal. | ||
|
||
* Navigate to DigArchDiskStation. | ||
|
||
* Change into diskImages directory. | ||
```$ cd /Volumes/DigArchDiskStation/Staging/ingest/diskImages``` | ||
|
||
* Create a directory for your collection if it does not exist. | ||
```$ mkdir ACQ_acqID``` | ||
|
||
* Change into your collection directory. | ||
```$ cd ACQ_acqID``` | ||
|
||
* Run [makesips script](https://nypl.github.io/digarch/tools/working-scripts.html#makesips-sipdirsh){:target="_blank"} to create a consecutive number of submission information packages for material from digital media. | ||
|
||
Or | ||
|
||
* Change to diskImages directory. | ||
|
||
```$ cd /Volumes/DigArchDiskStation/Staging/ingest/diskImages``` | ||
* Enter ```mkdir``` command. | ||
```mkdir -p ACQ_acqID/ACQ_acqID_specObjectID/{metadata,objects}``` | ||
|
||
On Windows via WSL: | ||
|
||
* Open WSL. | ||
* If you do not see the Y:\ drive in /mnt or /mnt/y appears to be empty then it must be re-mounted by: | ||
* Changing to the top level directory by entering ```cd ../``` | ||
* Entering the command ```sudo mount drvfs Y: /mnt/y``` | ||
* Change into diskImages directory. | ||
```$ cd /mnt/y/Staging/ingest/diskImages``` | ||
|
||
* Create a directory for the acquisition if it does not exist. | ||
```$ mkdir ACQ_acqID``` | ||
|
||
* Change into the acquisition directory. | ||
```$ cd ACQ_acqID``` | ||
|
||
* Run [makesips script](https://nypl.github.io/digarch/tools/working-scripts.html#makesips-sipdirsh){:target="_blank"} to create a consecutive number of submission information packages for material from digital media. | ||
|
||
Or | ||
|
||
* Change to diskImages directory. | ||
|
||
```$ cd /mnt/y/Staging/ingest/diskImages``` | ||
* Enter ```mkdir``` command. | ||
```mkdir -p ACQ_acqID/ACQ_acqID_specObjectID/{metadata,objects}``` | ||
|
||
#### Directory structure | ||
|
||
* /M2319-0021 | ||
* /metadata | ||
* | ||
* /objects | ||
|
||
|
||
<!-- ![](media/media/image29.png){width="6.069444444444445in" | ||
height="2.3472222222222223in"} --> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Align Package Images instructions for Floppy and Iomega