MithiDocs

Archiving Object Storage to Vaultastic

Overview

Many organizations store large volumes of unstructured data in cloud object storage platforms, including:

  • Amazon S3

  • Azure Blob Storage

  • Google Cloud Storage

These repositories commonly contain:

  • Application-generated data

  • Logs and telemetry archives

  • Media assets

  • Exported database snapshots

  • Compliance records

  • Data lake objects

While object storage platforms provide high durability and scalability, they do not inherently provide:

  • Centralized compliance indexing

  • Unified cross-source search

  • Supervisory workflows

  • Consolidated governance across communication and file data

Using LegacyFlo, data from these object storage platforms can be copied into Vaultastic to establish structured archival, enforce retention policies, and support compliance workflows.


Vaultastic Storage Targets

Object storage data is typically archived into the following Vaultastic storage tiers.

StoreUse Case
Open StoreMedium-term archival where data may require periodic access or search
Deep StoreLong-term archival optimized for low-frequency access and lower storage cost

The appropriate storage tier depends on:

  • Expected retrieval frequency

  • Regulatory retention requirements

  • Cost sensitivity

  • Legal hold considerations


Object Storage Ingestion Overview

The following table summarizes supported object storage ingestion options.

Data SourceDestination StoreMethodDescription
Amazon S3 BucketsOpen / Deep StoreLegacyFloCopies objects from S3 buckets into Vaultastic
Azure Blob ContainersOpen / Deep StoreLegacyFloRetrieves blobs and transfers them to Vaultastic
Google Cloud Storage BucketsOpen / Deep StoreLegacyFloExtracts objects and uploads them to Vaultastic

During ingestion, object metadata is preserved and retention policies can be applied.


Object Storage Ingestion Process

LegacyFlo performs object storage archival using the following workflow:

  1. Connects securely to the source object storage platform.

  2. Authenticates using service credentials.

  3. Enumerates selected buckets or containers.

  4. Copies objects and associated metadata.

  5. Uploads the data into Vaultastic Open Store or Deep Store.

  6. Applies indexing and retention policies.

This process enables structured archival while preserving the original object structure.


Supported Ingestion Scenarios

Vaultastic supports multiple ingestion scenarios depending on operational needs.

Full Bucket Migration

Entire buckets or containers can be copied into Vaultastic.

This approach is typically used for:

  • System decommissioning

  • Data consolidation projects

  • Migration from one storage platform to another


Prefix or Folder-Based Archival

Specific paths within a bucket can be archived.

This enables structured archival by:

  • Department

  • Application

  • Workload

  • Project


Date-Based Archival

Objects older than a defined threshold can be archived.

This approach allows organizations to move aging or inactive objects into Vaultastic archival tiers.


Scheduled Incremental Archival

LegacyFlo can schedule recurring ingestion jobs to archive newly created objects.

This enables continuous archival of cloud storage environments used for compliance-sensitive workloads.


Why Archive Cloud Object Storage to Vaultastic

Compliance and Governance

Object storage platforms primarily focus on durability and scalability. They typically lack features needed for regulatory workflows.

Vaultastic provides:

  • Centralized retention enforcement

  • Indexed search across archived data

  • Audit logging

  • Integration with compliance and investigation workflows


Cost Optimization

Cloud object storage costs can grow rapidly as data volumes increase.

Archiving data into Vaultastic enables organizations to:

  • Reduce active storage footprint

  • Move aging objects into Deep Store

  • Optimize storage lifecycle management


Unified Data Governance

Many organizations operate multi-cloud environments.

Archiving into Vaultastic enables:

  • Consolidation across cloud platforms

  • Centralized search across archived datasets

  • Standardized retention policies


Risk Reduction

Cloud storage environments may be exposed to risks such as:

  • Misconfigured public access

  • Accidental deletion

  • Credential compromise

Vaultastic archival provides an additional preservation layer separate from production storage.


Security and Access Configuration

LegacyFlo requires secure access credentials to connect to source object storage platforms.

Typical credential models include:

PlatformCredential Model
AWS S3IAM user or role with read-only bucket access
Azure Blob StorageService principal or SAS token
Google Cloud StorageService account with object viewer permissions

Access should follow least-privilege principles.

Vaultastic implementation teams typically assist with:

  • Permission scoping

  • Endpoint configuration

  • Transfer validation


Initial Configuration

Follow these steps to archive cloud object storage into Vaultastic.

1. Identify Archival Scope

Select the buckets or containers that should be archived.

Determine:

  • Retention classification (Open Store or Deep Store)

  • Whether ingestion will be one-time or recurring


2. Provision Source Credentials

Create read-only access credentials for the source object storage.

Ensure that:

  • Access permissions follow least-privilege principles

  • Connectivity from the LegacyFlo environment is validated


3. Configure LegacyFlo Ingestion

Define the ingestion request with the following details:

  • Object storage endpoint

  • Bucket or container name

  • Prefix or path (if applicable)

  • Destination Vaultastic store

Optional filtering rules can also be configured.


4. Execute Initial Migration

Run the first ingestion job and verify that:

  • All objects are transferred successfully

  • Metadata is preserved

  • Indexing is functioning correctly


5. Configure Recurring Archival (Optional)

If ongoing archival is required:

  • Schedule incremental ingestion jobs

  • Monitor transfer logs and execution status

  • Periodically validate completeness


Recommended Implementation Sequence

A typical deployment follows this sequence:

  1. Classify object storage data by retention and sensitivity.

  2. Select Open Store or Deep Store based on access patterns.

  3. Provision least-privilege access credentials.

  4. Configure and test the LegacyFlo ingestion job.

  5. Execute the initial migration.

  6. Enable scheduled synchronization if continuous archival is required.

  7. Validate indexing, searchability, and retention enforcement.


Benefits of Object Storage Archival in Vaultastic

Archiving cloud object storage into Vaultastic provides:

  • Centralized governance across cloud environments

  • Regulatory-compliant retention controls

  • Reduced exposure of primary storage systems

  • Centralized indexing and discovery

  • Durable preservation independent of production workloads

By ingesting object storage platforms into Vaultastic Open or Deep Store, organizations establish a structured and compliant archival framework across their cloud infrastructure.