How Autymate Streamlined 30 Million Record Upload Process.

HEALTHCAREfirst regularly received the claims data from many 3rd party providers once a quarter.  In total, there were 52 CSV and Excel files, containing approximately 30 million records of patient data. ‍ These files were supposed to adhere to a standard format and naming convention to allow a successful file load.  Unfortunately, it was common for many third-party providers to misspell column headings and file names, or even change the naming convention altogether.  These minor misspellings resulted in frequent breaks while attempting to load the data. ‍ When an error did occur, identifying and resolving the problem was it’s own challenge.  Standard, uninformative error messages like “object reference not found” left the development team searching for one specific data point among thousands, the equivalent to finding a needle in a haystack.  It often took up to 3 full working days to identify and correct the errors within just one file.