Tasks Log

[billy1624]

Completed

• Crawling data from crates.io index from scratch
• Fetching incremental updates from crates.io index
• Pushing collected data of node and edge to the API for storage
• Defining database schema for storing metadata and data of homogeneous and heterogeneous graph
• Migrating database schema for storing metadata on startup
• Altering database schema in runtime when a new entity or relation was created
• Handling API requests with independent endpoints, i.e. /schema/*, /mutate/* and /query/*
• Calculating node connectivity
  • Simple (incoming and outgoing) connectivity
  • Compound incoming connectivity
  • Complex incoming connectivity with decade factor of 0.7
  • Complex incoming connectivity with decade factor of 0.5
  • Complex incoming connectivity with decade factor of 0.3
• Querying homogeneous graph and tree with multiple executors running in parallel
• Querying graph and tree visualization with user provided parameters
  • Root node(s) of a graph or tree
  • Maximum depth of a graph or tree
  • Maximum number of node on each depth in a graph or tree
• Implemented simple UI for graph and tree visualization with adjustable parameters
• Handled API requests with integrated endpoints, i.e. /schema, /mutate and /query, using Serde enum
• Unit tested all API endpoints on a live database
• Use new /schema endpoint in reset_schema.js
• Use new /mutate endpoint in calculate_connectivity.js
• Removing handler of API requests with independent endpoints, i.e. /schema/*, /mutate/* and /query/*
• Querying graph and tree data with global limit on the maximum number of node or edge
• Visualizing homogeneous graph and tree with improved UI
• Investigating the graphs and try to find some interesting observations

In Progress

• Making StarfishQL database agnostic, including MySQL, PostgreSQL and SQLite StarfishQL backed by multiple database backends #7

Next Up

• Querying heterogeneous graph and tree
• Visualizing heterogeneous graph and tree
• Designing UI of homepage, graph and tree visualization page
• Querying graph and tree data with time limit

[tyt2y3]

Can update the progress again?

[billy1624]

Can update the progress again?

Updated!

[billy1624]

CC @shpun817