MithiDocs

Release Notes

25th Nov 2022: Version 1.29.30.5

New Feature

A new request type O365-S3-PST has been added to copy data from an O365 mailbox to a PST file on Vaultastic Open Store or your own S3 bucket.


11th Nov 2022: Version 1.29.30.4

Improvement

The O365-S3-ZIP  request has been updated to authenticate using the OAuth authentication method.

                                                                                 

9th Nov 2022: Version  1.29.30.3

Improvement

The O365-VAULTASTIC4 request has been updated to authenticate using the OAuth authentication method.


20th Oct 2022: Version 1.29.30.2

New feature

A new request type FRESHDESK-S3-ZIP has been added to allow admins to take a backup of the Freshdesk Solutions. The LegacyFlo request will take a backup of all the articles published at the time of the backup. In Freshdesk the Solutions are maintained in a three level hierarchy of Categories->Folders->Articles. This hierarchical structure is maintained in the backup. Each Article is a separate file. The contents of the backup are compressed into a zip file.


The backup can be taken on the Vaultastic Open Store or your own bucket. For more details on how to use LegacyFlo to backup Freskdesk Solutions, refer to these topics:

Backup Freshdesk Solution Articles to Vaultastic Open Store

Backup Freshdesk Solution Articles to own S3 bucket


25th Sep 2022: Version 1.29.30.0

New feature

A new request type GDrive-S3-Zip has been added that allows you to backup files from users GDrive to Vaultastic Inactive Store or a S3 bucket in your own account.


For more details, refer to these topics:


22nd Sep 2022: Version 1.29.29.1

Improvements

A separate queue now handles all export requests fired from the eDiscovery Application on the Vaultastic Active Store. This ensures that end-user requests are scheduled for execution as early as possible and are not affected by other migration jobs fired via the LegacyFlo Interface


20th Sep 2022: Version 1.29.29.0

New Feature

End users can now register or revoke access to their Google Workspace API (For GDrive & GMail) using the GUI.  The interface allows you to upload the access key. These are required for the requests which retrieve data from the Google Workspace to upload to Vaultastic or own S3 buckets.


For more details, refer to the topic on Getting Access Key from Google Workspace and registering with LegacyFlo


15th Aug 2022: Version 1.29.28.9

Improvements

The performance of the LegacyFlo requests which help in storage management on Vaultastic (automatic movement of data from Active to Inactive and Vault deletion) have been optimized to give better performance and use less resources. Request type affected are:

VV4-MOVETOINACTIVE-EML

VV4-MOVETOINACTIVE-PST

VV4-VAULT-RETENTION

VV4-VAULT-DEL


9th Jul 2022: Version 1.29.28.8

Improvements

The LegacyFlo infrastructure management team can now dynamically update the concurrency of different request type to improve overall system performance


11th May 2022: Version 1.29.28.7

Improvements

  • The LegacyFlo backend has been updated to use modern processors to improve overall performance
  • The  detailed reports generated from the UI now have additional information about the execution status

Bugs

  • Resolved an issue in the validation step for VV4-MOVETOINACTIVE-EML request type.
  • Resolved an issue in getting the bucket location using S3 pre-signed URLs.
  • Resolved the problem of reading the Vaultastic server credentials.

8th Feb 2022: Version 1.29.28.6

Bugs

  • Resolved the problem of VV4-VAULT-RETENTION and VV4-VAULT-DEL request types not terminating


1st Feb 2022: Version 1.29.28.5

Improvements

  • Improved the performance of  VV4-VAULT-RETENTION and VV4-VAULT-DEL request types by launching resources in the appropriate AWS region.
  • Improved the request processing to handle more requests in parallel.

Bugs

  • Resolved a bug in the request type EML-PST to handle special characters in the destination folder.

13th Jan 2022: Version 1.29.28.4


Improvements

  • Improved the performance of VV4-VAULT-DEL, VV4-VAULT-RETENTION, VAULTASTIC4-S3-PST, VAULTASTIC4-S3-EML, VAULTASTIC4-MOVETOINACTIVE-PST, VAULTASTIC4-MOVETOINACTIVE-EML, eDiscovery Export request types by optimizing the resource allocation

Bugs

  • Resolved the problems in status updates for VV4-VAULT-DEL, VV4-VAULT-RETENTION, EML-METADATA and VV4-VAULT-RETENTION request types


03rd Dec 2021: Version 1.29.28.3

New Feature

Added new job type EML-METADATA to

  • Create and upload metadata in the specified S3 bucket
  • Create a zip of mails whose metadata is not created and upload along with CSV

26th Nov 2021: Version 1.28.28.3

Improvements

Added header named 'sortableDate' which addresses the issue of sorting of rows with dates.  Following jobs are affected by this update

  • IMAP-S3-ZIP
  • MITHI-S3-PS

17th Nov 2021: Version 1.28.27.3

Improvements

Spot instances will be used for executing the following jobs

  • VAULTASTIC4-S3-PST
  • VAULTASTIC4-S3-ZIP
  • VV4-MOVETOINACTIVE-EML
  • VV4-MOVETOINACTIVE-PST



26th Oct 2021: Version 1.28.26.3

New Feature

Added functionality to generate the API key and Client Id in Legacyflo


19th Oct 2021: Version 1.27.26.3

Improvement

The following improvements are released for the request type MAILDIR-MITHI-IMAP

  • Removed Access Key and Secret key dependencies to download Zip file from S3
  • Logs can be uploaded to S3 and downloaded from Legacyflo interface
  • Solved Heap memory error by implementing pagination

13th Oct 2021: Version 1.27.25.3

Improvement

The following request type will migrate data over private IP to the destination server. This includes all SkyConnect servers in Mumbai and Singapore regions.

  • GMAIL-MITHI-IMAP
  • O365-MITHI-IMAP
  • YAHOO-MITHI-IMAP
  • IMAP-MITHI-IMAP

06th Oct 2021: Version 1.27.24.3

New Feature

New Legacyflo job type PST-EXTRACT released

  • All users of Legacyflo can access this job
  • In this user has to provide a CSV file with headers in the following order subject,to,from,cc,Date
  • Added src file validation. A PST of the maximum size of 100  GB is allowed
  • The UI form will have source bucket, destination bucket, source folder path, destination folderpath preconfigured with inactive store details. However, users can modify these inputs
  • This job will create a zip file of mails found while searching and upload to the provided bucket path
  • CSV file will also get uploaded to the same location
  • The CSV file can have maximum 150 rows (including headers) and 10 MB size
  • The destination zip file will be uploaded with name <user-provided>_Pst-Extract_<epochTimestamp>.zip

01st Oct 2021: Version 1.26.24.3

Improvements

Following improvements released for the job EML-EXTRACT

  • Added src file validation. A zip with the max size of 100  GB is allowed.
  • The UI form will have the source bucket, destination bucket, source folder path, and destination folder path pre-configured with inactive store details. However, inputs can be modified.

23rd Sep 2021: Version 1.26.23.3

New Feature

New Legacyflo job released EML-EXTRACT

  • All users of Legacyflo can access this job
  • In this user has to provide a CSV file with headers in the following order subject,to,from,cc,Date
  • This job will create a zip file of mails found while searching and upload to the provided bucket path
  • CSV file will also get uploaded to the same location.
  • This will currently launched with 400 GB of disk and can handle max zip size of 150 GB
  • The CSV file can have max 150 rows (including headers) and 10 MB in size
  • This job will run on on-Demand instances
  • The destination zip file will be uploaded with name <user-provided>_Eml-Extract_<epochTimestamp>.zip



21st Sep 2021: Version 1.25.23.3

New Feature

Super admins can now be able to download the log file on request from the Legacyflo application 

  1. This option is available only for processed, failed, and partial-processed jobs
  2. This can download the log file of any size
  3. The download link is valid for 900 seconds

NOTE:

  1. Few Jobs types do not have logs on S3 and are available only in cloudwatch
  2. Logs of these job types cannot be downloaded from Legacyflo. In this case, Legacyflo will provide an appropriate error message.

01st Sep 2021: Version 1.24.23.3

Bugs fix

  1. Submitting the request to export mail will export mails from the account, who submit the request. Following jobs are affected by this update,
  • VAULTASTIC4-S3-PST
  • VAULTASTIC4-S3-ZIP
  • VV4-MOVETO-INACTIVE-EML
  • VV4-MOVETO-INACTIVE-PST
  1.  Removed the password authentication of VV4-MOVETOINACTIVE-PST job in the Legacyflo. This job will not be validated now. Users can submit this job without the password.

17th Aug 2021: Version 1.24.23.2

Improvements

Added a CSV based error log filtering that shows more precise, clear and understandable error message of imapsync based jobs. It has a fallback error message of "Imapsync failed due to internal server error".

Following jobs are affected by this update, 

  • IMAP-MITHI-IMAP
  • GMAIL-MITHI-IMAP
  • O365-MITHI-IMAP
  • O365-MITHI-IMAP-ALL
  • O365-O365-IMAP
  • YAHOO-MITHI-IMAP
  • YAHOO-O365-IMAP
  • YAHOO-OTHER-IMAP

06th August 2021: Version 1.24.22.2

Improvements

  • Added new job type VV4-VAULT-DEL which can be used to process all the mails of the specified user for deletion.
  • Added new job type VV4-VAULT-RETENTION which can be used to process mails of one month of the specified user for deletion.
    • NOTE: These two jobs are only visible to the super admin users of Legacyflo.

2nd Aug 2021: Version 1.24.21.2

Improvements

  • Jobs GMAIL-S3-ZIP, GMAILOAUTH-S3-ZIP, IMAP-S3-ZIP, O365-S3-ZIP, YAHOO-S3-ZIP, MITHI-S3-PST and MITHI-S3-ZIP updated to create the data file and a corresponding CSV file with the metadata of the email in the data file to save time and cost when searching through the data files.

16th July 2021: Version 1.24.20.2

Improvements

  • Jobs VV4-MOVETOINACTIVE-PST, VV4-MOVETOINACTIVE-EML, VAULTASTIC4-S3-PST and VAULTASTIC4-S3-ZIP updated to create the data file and a corresponding CSV file with the metadata of the email in the data file to save time and cost when searching through the data files.

01st July 2021: Version 1.24.19.2

New Features

  • New request types added to LegacyFlo
    • VV4-MOVETOINACTIVE-EML
    • VV4-MOVETOINACTIVE-PST
    • VV4-MOVETOACTIVE-EML
    • VV4-MOVETOACTIVE-PST

25th May 2021: Version 1.23.19.2

New Features

  • A new feature is added to generate a detailed summary report and sent as an attachment. 

25th May 2021: Version 1.22.19.2

Improvements

  • Deletion of only Pending requests is allowed in LegacyFlo from now onwards.
  • Users can not delete any request whose status is other than Pending like Processed, failed, processing,  or submitted 

24th May 2021: Version 1.22.18.2

Improvements

  1. Improved search filters
    1. Job title: users can now search their request by any sub-string in their job title
    2. Request ID: user can now search for a single request by its request ID
  2. Added functionality to download the search results in the CSV format. The generated CSV file will be sent as an attachment to the email address provided. 

14th April 2021: Version 1.22.17.2

New features

  • New job type MITHI-S3-PST is added to the list. This job will get the data from the IMAP server, format the data in PST and store it at the provided S3 path.
  • This job type runs over on-Demand instances with a total of 200GB of disks.
  • It can process the job with a max source mailbox size of 150 GB.
  • Its concurrency depends on the source server.

26th March 2021: Version 1.21.17.2

New features

  • New job EML-PST is added to the list. 
  • Now, users can convert an EML to PST with a max size of 100 GB ZIP.
  • This job will use a separate job queue, runs over on-Demand with 200 GB of disk, very high concurrency as there will be no involvement of server.

22nd March 2021: Version 1.20.17.2

New features

  • A forgot password link is provided on the login page of LegacyFlo
  • Users can now reset their password using an OTP

23rd February 2021: Version 1.19.17.2

New features

  • New properties added in the LegacyFlo UI
  • It will show the total data (Retries counted) synced by the job in user-readable format Bytes, KB, MB, GB, TB

05th February 2021: Version 1.18.17.2

New features

  • New job VAULTASTIC4-REINDEXER is added to the list
  • Using parameters viz. domain, since date, and before date, it will send all mails between date range for that domain for re-indexing.

15th January 2021: Version 1.17.17.2

Improvements

  • Additional validation for domain provided in the destination. 
  • Validation will be restricted for the Vaultastic4 type of domain in the destination. 
  • By this validation, there will be no impact on SkyConnect domain.

08th January 2021: Version 1.17.16.2

Improvements

  • Updated the binaries that now scan the whole mailbox in a batch of 10000 instead of performing search operation through IMAP.  
  • It will reduce the load on the server and utilizes fewer resources on the server.
  • Following jobs are affected
    • GMAIL-S3-ZIP
    • GMAILOAUTH-S3-ZIP
    • O365-S3-ZIP
    • MITHI-S3-ZIP
    • IMAP-S3-ZIP

30th December 2020: Version 1.17.15.2

New features

  • New job VV3MAILSTREAM-VAULTASTIC4 added to the LegacyFlo
  • Using parameters viz mailstream bucket, date Range, and comma-separated domains, users can scan all the mails in the provided date range and domains and send them to V4 MR.

11th December 2020: Version 1.16.15.2

Improvements

  • O365-VAULTASTIC4 job type in LegacyFlo app will now support the migration of delegated users with admin password by enabling the user delegation in exchange server and providing domain followed by '/<user name>' as job input form of source side.

25th November 2020: Version 1.16.14.2

Improvements

  • Improved the architecture of Vaultastic4 export by removing the intermediate FTS proxy for downloading mails and it addressed the slow download speed. It gained speed nearly 6x times the old one.
  • Created an LDAP patch that extends the limit of eDiscovery export limit for the user to allow them to submit an export request up to 45 GB.
  • Created a single ZIp/PST of exported Data, previously it was split into multiple files.

25th November 2020: Version 1.16.13.2

Improvements

  • Improved the caching mechanism in the following job types. 
  • Earlier it was using messageID and MD5 sum from the header to cache mails.
  • The new caching mechanism uses message UID and it results in the sync of all mails from src to destination because even if two messages are the same they have different message UID.
  • Impacted job Types
    • VAULTASTIC3-VAULTASTIC4
    • GMAIL-VAULTASTIC4
    • GMAILOAUTH-VAULTASTIC4
    • YAHOO-VAULTASTIC4
    • O365-VAULTASTIC4
    • EXCHANGE-VAULTASTIC4
    • MITHI-S3-ZIP
    • GMAIL-S3-ZIP
    • GMAILOAUTH-S3-ZIP
    • O365-S3-ZIP
    • YAHOO-S3-ZIP
    • IMAP-S3-ZIP

29th September 2020: Version 1.16.12.2

Improvements

  • Ingest data in EMLMBOXMAILDIRor PST format into Vaultastic or SkyConnect

22nd September 2020: Version 1.16.11.2

New Features

  • New job types added to LegacyFlo
    • IMAP-VAULTASTIC4
    • EXCHANGE-VAULTASTIC4

08th September 2020: Version 1.15.11.2

New Features

  • New job types added to LegacyFlo
    • GMAIL-VAULTASTIC4
    • GMAILOAUTH-VAULTASTIC4
    • O365-VAULTASTIC4
    • YAHOO-VAULTASTIC4

02nd September 2020: Version 1.14.11.2

New Features

  • New job types added to LegacyFlo to import data files in Vaultastic 4
    • PST-VAULTASTIC4
    • EML-VAULTASTIC4
       

29th August 2020: Version 1.13.11.2

New Features

  • New job type added to LegacyFlo that allows super admins to migrate from Vaultastic 3 to Vaultastic 4
    • VAULTASTIC3-VAULTASTIC4 

06th August 2020: Version 1.12.11.2

New Features

  • New input parameters s3sourceBucket and s3sourceBucket Region added to the UI for the following jobs.
    • EML-MITHI-IMAP
    • PST-MITHI-IMAP
    • MBOX-MITHI-IMAP
    • MAILDIR-MITHI-IMAP

03rd August 2020: Version 1.11.11.2

New Features

  • The UI change for import to Vaultastic4 Job Type deployed in the staging account.
  • With this update user will not have to know the vaultastic4 bucket its path. He can use the IMAP credentials to post the job unlike the other IMAP jobs.
  • Affected Job types:
    • EML-VAULTASTIC4
    • PST-VAULTASTIC4
    • MAILDIR-VAULTASTIC4
    • MBOX-VAULTASTIC4
    • GMAIL-VAULTASTIC4
    • GMAILOAUTH-VAULTASTIC4 
    • O365-VAULTASTIC4
    • VAULTASTIC3-VAULTASTIC4
    • YAHOO-VAULTASTIC4

19th July 2020: Version 1.10.11.2

New Features

  • New input parameters s3sourceBucket and s3sourceBucket Region added to the following jobs.
    • EML-MITHI-IMAP
    • PST-MITHI-IMAP
    • MBOX-MITHI-IMAP 
    • MAILDIR-MITHI-IMAP

24th June 2020: Version 1.9.11.2

New Features

Release in MIthi staging account

  • LegacyFlo new App type Vaultastic4-s3-zip is deployed in the staging account
  • Users can now export mails from vaultastic4 to s3 zip like MITHI-S3-ZIP. This job uses solr queries and Fts API to fetch export mails. Users can export all emails, emails between a date range.
  • In the case of Partial processed, the LegacyFlo UI will turn into an Orange processed icon instead of the green processed icon. 
  • Users are not allowed to resubmit but can restart the job again.

Improvements

  • Mails greater than 10 MB in size can be exported using this job, which was a limitation on v3 export.

16th January 2020: Version 1.8.10.2

New Features

  • Added new request type MAILDIR-MITHI-IMAP in LegacyFlo

Improvements

  • Now user can select the source folder path from the source mailbox folder list for the request type MITHI-S3-ZIP.
  • LegacyFlo directory table added to store user details.
  • Directory table is currently used to enable or disable a LegacyFlo user.
  • If a user is disabled, then that user will not be able to submit a job for execution.
  • If an entry for a user does not exist in the table, then the user will be treated as an enabled user

16th December 2019: Version 1.7.9.2

New Features

  • New request type MITHI-S3-ZIP added to LegacyFlo
  • Users can now sync emails from MITHI account  to s3 bucket in EML zip format 
  • The batchjob will now launch in S3 region when the job is either O365-S3-ZIP ,YAHOO-S3-ZIP or  Gmail-S3-Zip and in the Mithi server region when the job is for Mithi-S3-Zip.

10th December 2019: Version 1.6.9.2

New Features

  • New request types added to LegacyFlo 
    • O365-S3-ZIP: Users can now sync emails from an O365 account  to an S3 bucket in EML ZIP format
    • YAHOO-S3-ZIP: Users can now sync emails from a Yahoo account to an S3 bucket in EML ZIP format

22nd October 2019: Version 1.5.9.2

New Features

  • New request types added to LegacyFlo 
    • Gmail-S3-Zip: Users can now sync emails from a Gmail account to an S3 bucket in EML zip format


21st October 2019: Version 1.4.9.2

New Features

  • Users can now sync a single folder from the source IMAP account to the destination account. 
  • Users have to provide the exact path of the folder from the source folder with folder separator and prefix. 
    • For example, 
    • In the case of O365 & GSUIT:
      • Folder Prefix: N/A
      • folder separator: '/'
    • In Case of Mithi servers:
      • Folder Prefix: INBOX.
      • Folder separator: '.'

Bug fixes

  • While syncing folders get skipped if the folder name contains ',' in it.
  • Sometimes multiple status update calls were happening in a single minute. 

16th October 2019: Version 1.4.8.1

Improvements

  • Removed the batch job queue reversion from the config file.
  • AWS Batch automatically picks the latest reversion of the job queue though not provided.
  • Added Cross-region support in LegacyFlo in which Ec2 launches (for processing the import job) in the same region where the mail server is, which reduces cross-region data transfer costs.

04th October 2019: Version 1.4.7.1

New Features

  • New request types added to LegacyFlo
    • YAHOO-MITHI-IMAP
    • O365-GMAIL-IMAP
    • GMAIL-O365-IMAP
    • YAHOO-O365-IMAP
    • YAHOO-GMAIL-IMAP
    • YAHOO-OTHER-IMAP
  • Rename old request types names to make uniform naming.
    • PST-MITHI-IMAP
    • EML-MITHI-IMAP
    • MBOX-MITHI-IMAP 
    • IMAP-MITHI-IMAP
    • O365-MITHI-IMAP
    • GMAIL-MITHI-IMAP
    • EXCHANGE-MITHI-IMAP
  • Added support for importing data into external Servers (Servers Other than Mithi servers)



01st October 2019: Version 1.3.7.1

Improvements

  • Updated Node js version for lambdas from v6.10 to v8.10.

16th September 2019: Version 1.3.6.1

New Features

  • Added Central status update module to update CADB and RequestRepository parallelly. If the status update call failed then the status update will be retried after 2 mins for 10 times.
  • Added additional Tagging on EC2 And EBS volume to get consumption based on request id, batchjob id, admin id, and user id for whom migrations are happening.
  • Added the Cleanup process on/ batch work to remove execution records of previous execution if any.
  • Now, histlive.mithi.com and LegacyFlo.mithi.com both are pointing to the same CloudFront distribution.  In the earlier version, they were pointing to 2 separate distributions.

03rd September 2019: Version 1.2.6.1

Improvements

  • Removed restriction on characters in the password, except for " as imapsync not able to handle characters.
  • Now users can use (`,$,\, !,#,@,%,^,&,*,(,),') as part of password.

09th August 2019: Version 1.2.5.1

Improvements

  • Added New BatchQueue to launch EC2 instance with XLEBS volume attached to it to solve "No disk Space left"  issue for imapsync of mail count greater than 500000.

16th July 2019: Version 1.2.4.1

Improvements

  • Solved negative data sync in bytes issue
    • made legacyflo.mithi.com live with new and improved UI.
    • removed browser dependent bugs.

28th June 2019: Version 1.2.3.1

New Features

  • Legacy Flo CI/CD for UI Deployment is ready and Deployed till the staging account will do deploy in the live account after Testing.

08th March 2019: Version 1.1.3.1

Improvements

  • In EML and PST sync added Source mail stats, Destination mail stats, and total bytes transferred from source to destination.

07th March 2019: Version 1.1.2.1

Improvements

  • MBOX sync added source mail stats, destination mail stats, and total bytes transferred from source to destination.
  • Got problem where if sync is in progress and if destination server gets down or start to refuse connection module keeps trying to sync further messages without raising an exception and for each message it tries to connect server 3 times so it just keeps wasting time. so added condition which will break sync after trying to upload 10 messages and get server refuse error.  

05th March 2019: Version 1.1.1.1

Bug Fixes

  • MBOX Job zip file extraction failing if containing path have Unicode characters:
  • If the zip file module failed to extract the file then, unzip command will be called to extract the file if it failed to extract then the user will be shown with an error given by Unzip command

28th February 2019: Version 1.1.1.0

Improvements

  • batchInputValidatior lambda
  • Added rejectUnauthorized: false, secureProtocol:'TLSv1_method' in tlsOptions to (Zimbra server connection issue)
  • Added validation for the file size limit for PST (48 Gb) and zip(12 Gb) files.

27th February 2019: Version 1.1.0.0

Improvements

  • Menu disables on clicking on the start all button.
  • Display the no of jobs currently visible on the page.
  • Solved page number issue (page number was not reset when a new filter is applied on the job)
  • Job timings are shown to users according to the local timezone. For admin, it will be in both local and UTC time
  • Information menu UI Changed
  • Removed read-only attribute in the edit section of Imap