Socotra
API ReferenceReporting API

Data Lake Delta Files API

ActionEndpoint
Fetch Delta FilesPOST/business-stats/delta-files/list
Fetch Delta FilePOST/business-stats/delta-files/download

Delta File Endpoints

Fetch List of Delta Files

Fetch List of Delta FilesfetchDeltaFiles
POST/business-stats/delta-files/list
Security Group:delta-files
Permission:
read

Fetch Specific Delta File

Fetch Specific Delta FilefetchDeltaFile
POST/business-stats/delta-files/download
Response:StreamingResponseBody<string>
Security Group:delta-files
Permission:
read

Delta File Request and Response Objects

DeltaFilesGetRequest

Required properties

PropertyTypeDescription
tenantLocatoruuidLocator of the tenant corresponding to the data
transformationTableEnum DataLakeAccountDataExtensions | DataLakeAccounts | DataLakeAffectedTransactions | DataLakeAuxData | DataLakeBillingHolds | DataLakeClaimDataExtensions | DataLakeClaims | DataLakeCreditDistributions | DataLakeCreditItems | DataLakeDelinquencies | DataLakeDelinquencyReferences | DataLakeDiaries | DataLakeDisbursementDataExtensions | DataLakeDisbursements | DataLakeFaTransactionAccountLines | DataLakeFaTransactions | DataLakeFnolDataExtensions | DataLakeFnols | DataLakeInstallmentItems | DataLakeInstallments | DataLakeInstallmentSettings | DataLakeInvoiceItems | DataLakeInvoices | DataLakeLedgerAccountLineItems | DataLakeLedgerAccounts | DataLakeMoratoriumElections | DataLakeMoratoriums | DataLakeMoratoriumStatuses | DataLakePaymentDataExtensions | DataLakePayments | DataLakePolicies | DataLakePolicyAutoRenewals | DataLakePolicyCoverageTerms | DataLakePolicyDataExtensions | DataLakePolicyElementCharges | DataLakePolicyElements | DataLakePolicyElementTree | DataLakePolicyElementUnderwritingFlags | DataLakePolicyPreferences | DataLakePolicySegments | DataLakePolicyStatuses | DataLakePolicyTerms | DataLakePolicyTransactionChangeInstructions | DataLakePolicyTransactions | DataLakeProducerCodeDataExtensions | DataLakeProducerCodes | DataLakeProducerDataExtensions | DataLakeProducerHierarchy | DataLakeProducers | DataLakeQuoteCoverageTerms | DataLakeQuoteDataExtensions | DataLakeQuoteElementCharges | DataLakeQuoteElements | DataLakeQuoteElementTree | DataLakeQuoteElementUnderwritingFlags | DataLakeQuotes | DataLakeTaskReferences | DataLakeTasks | DataLakeUserAssociations | DataLakeUserQualifications | DataLakeWriteOffsName of the desired Data Lake table

Optional properties

PropertyTypeDescription
startTimeinteger?Files in returned index will all have a generationTime later than startTime. Format is UNIX timestamp in UTC milliseconds (e.g. 1741713134934)
dataProcessedThroughTimeinteger?Only files with a dataProcessedThroughTime prior to or equal to this time will be returned. Format is UNIX timestamp in UTC seconds (e.g. 1451606100)
deltaFileTypeEnum? sql | csvThe format of the delta files to be returned. Defaults to sql if omitted
lastFilestring?Only files after this file in the index will be returned. Must provide full fileName
versioninteger?Target a specific schema version; defaults to latest if omitted
DeltaFilesGetResponse

Required properties

PropertyTypeDescription
createTableFilestringPath & name of file with necessary sql statement to create the table in the destination schema
dataProcessedThroughTimeintegerThe time of the latest operational change that will be reflected in the data. Format is UNIX timestamp in UTC seconds (e.g. 1451606100)
dropTableFilestringPath & name of file with necessary sql statement to drop the existing version of the table in the destination schema
s3BucketstringThe source S3 bucket required for the DeltaFileDownloadRequest
versionintegerTarget a specific schema version; defaults to latest if omitted
deltaFilesDeltaFile[]The index of individual delta files
DeltaFile

Required properties

PropertyTypeDescription
fileNamestringThe name of the delta file
deltaFileTypeEnum sql | csvThe format of the delta file
generationTimeintegerThe time that the file was generated. Format is UNIX timestamp in UTC milliseconds (e.g. 1741713134934)
jobEndTimeintegerThe that the job to generate the file ended. Format is UNIX timestamp in UTC seconds (e.g. 1451606100)
jobStartTimeintegerThe that the job to generate the file began. Format is UNIX timestamp in UTC seconds (e.g. 1451606100)

Optional properties

PropertyTypeDescription
md5HashSumstring?For files with deltaFileType = csv, the MD5 format hashsum for the file contents, including headers
recordCountinteger?For files with deltaFileType = csv, the number of rows in the file, excluding headers
DeltaFileDownloadRequest

Required properties

PropertyTypeDescription
tenantLocatoruuidLocator of the tenant corresponding to the data
fileNamestringThe name of the file to be requested. Value may be fileName, createTableFile, or dropTableFile

Optional properties

PropertyTypeDescription
s3Bucketstring?The name of the S3 bucket as returned by the DeltaFilesGetResponse. Only required if requesting createTableFile or dropTableFile, and deltaFileType is csv

See Also

On this page