Loading

DataBasics Blog and Information Bulletins

HOW TO Migrate Metadata From Cumulus to Flight

AdobeStock_32238763 (1)

 

Written by Jack Huang

This article will guide you through the process of migrating metadata from Cumulus to Flight. There are three parts to the process:

  • Exporting metadata from Cumulus
  • Formatting the metadata file from Cumulus
  • Importing metadata to Flight

Exporting metadata from Cumulus

To export the metadata from Cumulus you will need to use Cumulus Desktop Client.

Once you open the Catalog in Cumulus Desktop Client, select the file you want to export out metadata. In this example, we will select all asset records to be exported.

Once the assets records are selected, click on File -> Export -> Selected Records… as indicated in Screenshot 1 below.

Screenshot 1: Export menu

metadata_export

After ‘Selected Records…’ is clicked, an export window will pop up. Select ‘Cumulus 5-7 format (UTF-8)’ and choose the location you like to export.

Screenshot 2: Export Window

metadata_export_1

Click ‘Start’, once the export is completed, it will create a [filename].cre format file. Then user will need to change the file to ***.txt format.

Figure 3: Changing file format

metadata_export_2

You have now completed the export process.

Formatting the metadata file

The purpose of this process is to ensure the metadata file is readable for Flight.

Open an empty Excel document, Select Data -> From Text/CSV.

Figure 1: Open file in Excel

metadata_export_3

After the file is opened, Excel will show a preview window like below.

Figure 2: preview window

metadata_export_4

Make sure you select File Origin as ‘65001: Unicode (UTF-8)’.

Figure 3: File Origin

metadata_export_5

Then Click on Edit, you will see all data are list within a single Column.

Figure 4: Initial data

metadata_export_6

Select ‘Split Column by Delimiter’ Option.

Figure 5: Select Split

metadata_export_7

Select Tab as delimiter.

Figure 6: Select Tab

metadata_export_8

The data has now been divided into multiple columns.

Figure 7: Multiple Columns

metadata_export_9

Next step is to clean up rows 1-7 except row 4 by clicking ‘Remove Rows’.

Figure 8: Click Remove Rows

metadata_export_10

You need to remove the top three rows by selecting ‘Remove Top Rows’, then enter 3 in the appearing input box.

Figure 9: Selecting remove Top Rows

metadata_export_11

Once this is completed, you will see all the metadata field name appear in the row 1.

Figure 10: Removed top 3 rows

metadata_export_12

Next step: remove rows 2-4 by selecting ‘Remove Alternate Rows’.

Figure 11: Remove Alternate Rows option

metadata_export_13

In the appearing window below, enter 2 for ‘First row to remove’, enter 3 for number of rows to remove. Enter Number of rows to keep is depending on how much rows you have minus 3.

Figure 12: Remove Alternate Rows window

metadata_export_14

As shown in below (Figure 13) is displayed on the screen, row 1 is the metadata field name came from Cumulus, each remaining row represent one asset records in the Cumulus Catalog with the metadata in each column.

Figure 13: Cleaned data table

metadata_export_15

Go through each column, delete any column that you don’t like to import to Flight. Make sure column ‘Asset name’ is in the first column of the table, as this going to be the file name that Flight is looking at when these are imported.

Figure 14: Asset Name column is the first column

metadata_export_16

After selecting the columns that you like to import to Flight, Click on ‘Close & Load’ button.

Figure 15: Close & Load button

metadata_export_17

The following table will open in Excel mode, delete the first row which has “ColumnXXX”. Your metadata field will now become first row, then save this file as “.csv” format (comma delimiter) file.

Figure 16: Deleting first row of current table

metadata_export_18

Figure 17: New Metadata field row

metadata_export_19

You are now ready to import this metadata to Flight using Flight Metadata Importer.

Importing metadata to Flight

To import Cumulus metadata to Flight, you are required to get these two items ready:

  1. TEXT type Custom Fields are created in Flight
  2. Metadata Importer is enabled

These functions are only accessible to Flight admin users.

If you are logging in as Flight admin user, you can access Flight settings by hover your mouse cursor in the avatar icon, in the appearing menu, click on Settings.

Figure 1: Accessing Flight settings

metadata_export_20

Go to ‘Configuration Options’, then select ‘Custom Fields’. Copy the metadata field name from the csv file that was created in previous process “Formatting Metadata file” into “Field Name” input box, type in any description to this metadata field, select ‘TEXT’ field type, click on ‘Add’ once finished. In this example, it is using “Asset Identifier” which is the second column from the csv file.

Figure 2: Adding Custom Fields

metadata_export_21

Go to ‘Links & Connections’, then select ‘Metadata Import’. Click ‘Select’ to browse the csv file then click on upload.

Figure 3: Upload csv

metadata_export_22

Figure 4: Import csv

metadata_export_23

When all files are processed, go back to Flight home page by clicking the logo, select the files that were just imported for metadata. The metadata has been assigned to the image.

Figure 5: Result

metadata_export_24

You have completed the metadata import process.

Leave a Reply