Draft: Example nextjs site that imports repositories from GitHub to Splitgraph, then exports them to Seafowl, then renders a chart of stargazers#21

Open

milesrichardson wants to merge 36 commits intogenerated-import-pluginsfrom

example-nextjs-import-airbyte-github-export-seafowl

Commits on Jun 29, 2023

Add stub `examples/nextjs-import-airbyte-github-export-seafowl/`
milesrichardson
committed
Stub out layout and sidebar of GitHub analytics example
milesrichardson
committed
Add backend config and API routes for starting, awaiting import task
milesrichardson
committed
Add Stepper component with ImportPanel and ExportPanel
milesrichardson
committed
Implement backend API routes `start-export-to-seafowl` and `await-export-to-seafowl-task`
milesrichardson
committed
Implement the components for the "Export Panel"
milesrichardson
committed
Move lib-backend to lib/backend
milesrichardson
committed
Hardcode list of "relevant" table names for ingestion from GitHub
milesrichardson
committed
Serialize the stepper state into the URL, so that awaiting can be resumed across page loads
milesrichardson
committed
Move `lib/config.ts` -> `lib/config/github-tables.ts`
milesrichardson
committed
Export analytics queries to Seafowl in addition to tables
milesrichardson
committed
Track completed import/exports in a meta repository on Splitgraph
milesrichardson
committed
Support ?debug=1 parameter in URL of stepper to render DebugPane
milesrichardson
committed
Implement sidebar and stub out page for imported repository to show the charts
milesrichardson
committed
Install `@observablehq/plot` in `example-nextjs-import-airbyte-github-export-seafowl`
milesrichardson
committed
Render stargazers line chart with Observable Plot querying Seafowl
milesrichardson
committed
Refactor Observable plot: Add `useSqlPlot` hook and make file per plot
milesrichardson
committed
Refactor: use better name than `acc` in reduce function
milesrichardson
committed
Add styling, bells and whistles to stepper (text, buttons, loading bars, etc.)
milesrichardson
committed
Refactor
milesrichardson
committed
Display preview table for each loading/completed: either embed Splitgraph, or Seafowl
milesrichardson
committed
Allow toggling between Splitgraph/Seafowl embeds (once export has completed)
milesrichardson
committed
Use `<a>` tag for "Import Your Repository" link, to completely reset state (force SSR)
milesrichardson
committed
Add `formatTimeElapsed` function prop to `LoadingBar` for custom formatting of time elapsed message
milesrichardson
committed
Productionize the export step: add lots of nice styling, bells and whistles, etc.
milesrichardson
committed
Refactor
milesrichardson
committed
Only poll unique export taskIds, and do the polling from one hook instead of each component
milesrichardson
committed
Add workaround for failed exports of queries: create a fallback table
milesrichardson
committed
When embedding Seafowl query of exported queries, select from the destinationTable
milesrichardson
committed
Move embedded preview components to be shared with export panel and repo page
milesrichardson
committed
Add `reduceRows` method to `useSqlPlot` for case where mapping isn't enough
milesrichardson
committed
Add stacked bar chart of issue reactions by month with bars broken down by reaction type
milesrichardson
committed
Make repo page have three tabs: tables, queries and charts
milesrichardson
committed
Rename chart to IssueReactsByMonth
milesrichardson
committed
Bump GitHub import page size to 100, start date to 2023-01-01
milesrichardson
committed
Add scatter plot of user comment length vs. lines of code
milesrichardson
committed