[$300] Project Ubahn | Status on Bulk Upload API

[wdprice]

Track status, show in UI.
Display all uploads for the org

drill int to see failures and why.

[callmekatootie]

@cwdcwd Should we aim to implement this - https://marvelapp.com/prototype/8c98jb7/screen/68842315

[cwdcwd]

yessir

[callmekatootie]

So, the design has the following features:

• Searching profiles in the uploaded list
• List of profiles in the uploaded list
• Indicators for profiles that have errors in them
• Ability to edit / correct attributes of a profile
• To skip records that have errors in them, to proceed with the upload

Based on what we see, it appears that

• the feature is BEFORE the document is uploaded to our servers
  • this would mean that we are not uploading the excel file to the servers but parsing with the UI itself, and sending the parsed data...
• we need to fetch, in the UI itself, details about each user, that is part of the upload, to display values for attributes that the end user is NOT updating, but exists on the profile - for the user to update them through the UI itself. That is, user can update attributes of a profile that they did not specify in the excel, but updated later through the UI

If the feature is for AFTER the document is uploaded, then:

• how does the user view the status of the upload?
• The data would already have been uploaded. How then does the user Skip Errors and and Finish - the button in the UI.

[callmekatootie]

@cwdcwd @wdprice ^

[callmekatootie]

• Update Upload model to support new field failedRecordsObjectKey - which will contain the object key of the records that failed
• Update UploadService to support new route - GET /uploads?from=<date_time> that will return Upload records created since the from query param. By default use 24 hours.
• Update bulk processor to capture the object key of the uploaded error records and to pass it to the Upload model when updating the status of the processing
• Update the UI to display Records uploaded in the past 24 hours section under Bulk Upload tab, to display status of Uploads carried out in the past 24 hours. Here, for records where failedRecordsObjectKey exists, display a download link to download the failed records (which means that you need to generate signed s3 urls)

[callmekatootie]

• Restrict viewing upload status to the org the user is in

[cwdcwd]

Contest https://www.topcoder.com/challenges/30144226 has been created for this ticket.

This is an automated message for lazybaer via Topcoder X

[cwdcwd]

Contest https://www.topcoder.com/challenges/30144226 has been updated - it has been assigned to callmekatootie.

This is an automated message for lazybaer via Topcoder X

[cwdcwd]

Payment task has been updated: https://software.topcoder.com/review/actions/ViewProjectDetails?pid=30144226

This is an automated message for lazybaer via Topcoder X