avanade/emtech-distributed-data

Avanade's exploration of SQL Ledger, Confidential Ledger, and other data sharing technologies.

emtech-distributed-data's Issues

Car Sprites - Frontend

Remove these lines if scan continues to work with SSR setup

if (typeof window === "undefined") global.window = {};
if (typeof global.navigator === "undefined") global.navigator = {};

Line: 6

emtech-distributed-data//sql-ledger-demo/pages/_app.tsx

Lines 3 to 13 in ce054f1

	import Layout from "@/components/Layout";
	// Support SSR for webcam component in scan.js
	// TODO: Remove these lines if scan continues to work with SSR setup
	// if (typeof window === "undefined") global.window = {};
	//if (typeof global.navigator === "undefined") global.navigator = {};
	export default function LedgerApp({ Component, pageProps }: AppProps) {
	return (
	<Layout>
	<Component {...pageProps} />

Data Viewer

Add diagrams

Document setup for frontend

Frontend Env for Confidential Ledger

Set up demo website

REST API - Read

Additional SQL queries

• Delete data where ShareUntil date is before Now()

Have library randomly assign userid on first open

Following #63 and #65

QR Read Endpoint

Make QR read api endpoint to return a partner name from a QR code

Test Confidential Ledger - Retrieve

Set up API integration from frontend to server

Revoke Access Page

Won't do - will expire on the date

Spike: Compare mssql to tedious

Node SQL driver

Setup confidential ledger env

SQL setup - add basic data

Data Dashboard

Change fields in timeline

• Change date field to use share date for start, and shared until date for delete and update
• Add a status text for 'delete' rather than 'Unknown event'

Check SQL Ledger entries

Swap API routes with direct ledger table queries

Stretch goal, once API integration with python server is setup
https://docs.microsoft.com/en-us/sql/connect/node-js/step-1-configure-development-environment-for-node-js-development?view=sql-server-ver15

Store file redirect locally

Line: 274

emtech-distributed-data//ledger-server/app.py

Lines 271 to 281 in 86f1311

	video_details = await response.json()
	state = video_details["state"]
	if state == "processing":
	# TODO: Store file redirect locally
	return RedirectResponse(
	"https://bootsnipp.com/bootstrap-builder/libs/builder/icons/image.svg"
	)
	else:
	thumbnail_id = video_details["videos"][0]["thumbnailId"]
	async with await video_indexer.get_thumbnail(video_id, thumbnail_id) as response:
	thumbnail_file = await response.read()

Add link to cl-main licence compliance

Investigate Google Fit API

Add unit tests

Check SQL join statement

Check join statement works for getting a partner Id from a QRlocId when using SQL only

remove confidential ledger from main

Pylicence failing on missing requirement.txt

Store thumbnail in local blob storage to reduce calls out to Azure

Line: 261

emtech-distributed-data//ledger-server/app.py

Lines 258 to 268 in 86f1311

	async def video_processed(request):
	# TODO: Store thumbnail in local blob storage to reduce calls out to Azure
	return JSONResponse()
	async def video_thumbnail(request):
	video_uuid = request.query_params["video_uuid"]
	video_indexer = app.state.video_indexer
	async with await video_indexer.get_video_id_by_external_id(video_uuid) as response:

Set up sitemap structure

Set up Confidential Ledger

REST API - Append

Revoke data by ID

User setup library

Add dummy user / partner / QR data

More dummy data

Fix library connection for gh action

Remove from the final application

Line: 287

emtech-distributed-data//ledger-server/app.py

Lines 284 to 294 in 86f1311

	async def github_debug(request):
	"""Return the output from logged in GitHub users."""
	# TODO: Remove from the final application
	return JSONResponse({"auth": request.scope["auth"]})
	async def startup_get_video_indexer():
	app.state.video_indexer = await AsyncVideoIndexer.AsyncVideoIndexer.create(
	os.environ.get("VIDEO_INDEXER_ACCOUNT_ID"),
	os.environ.get("VIDEO_INDEXER_KEY"),

Create data structure in SQL

https://app.mural.co/t/avanade7180/m/avanade7180/1619447389066/768289864583203fae1058fa2aba1f3590f2225f

Add scenario docs for healthcare

• Benefits
• How tech supports this
• Can't drop table without dropping DB
• Only keys are stored in updateable SQL ledger - no PII data kept in keys
• Full auditability

Generate unique UUID, store in session cookie

Decide whether to remove simulator into dedicated app

Line: 12

emtech-distributed-data//ledger-server/sqlfunctions.py

Lines 9 to 19 in ce054f1

	from datetime import datetime
	import time
	# TODO: Decide whether to remove simulator into dedicated app
	def sqlEngine():
	load_dotenv() # take environment variables from .env.
	server = os.getenv("SERVER_NAME")

Delete data after expiry

Add datasets and dummy users

• Add data for all users
• Give Chris the userIDs

Pull and add data to database

Update HR Simulator

Update docs for setting up SQL Ledger and add SQL scripts

Data Share Page

QR Code Scan Page

Document setup for Backend