Skip to content

Lineage visualization #3462

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 69 commits into from
Closed

Lineage visualization #3462

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
69 commits
Select commit Hold shift + click to select a range
77965db
feature: add __str__ methods to queryLineage output classes
Jul 1, 2022
6d005e2
Merge pull request #1 from ytlee93/master
ytlee93 Jul 7, 2022
e0c59c2
Merge branch 'aws:master' into master
Snoyark Jul 11, 2022
7359b3d
feature: query lineage visualizer for general case
Jul 8, 2022
d524416
startarn added to lineageQueryResult
Jul 14, 2022
acf64f4
color node by lineage entity
Jul 14, 2022
e07e83c
identify startarn node by shape
Jul 14, 2022
687d6b6
Add code comments
Jul 14, 2022
e3a4c9d
Double sided arrows handled
Jul 15, 2022
1808f87
legend added
Jul 18, 2022
79b193a
feature: query lineage visualizer for general case
Jul 8, 2022
cbe445e
Merge pull request #3 from ytlee93/master
ytlee93 Jul 18, 2022
60904d5
try except raise
Jul 19, 2022
9125eb9
startarn added
Jul 19, 2022
3db7fa1
add get element function
Jul 19, 2022
c135ab9
add DashVisualizer class
Jul 19, 2022
daa5cc4
style check
Jul 19, 2022
0adc4db
Merge branch 'master' into advanced-style
Jul 19, 2022
28a9eeb
feature: query lineage visualizer advanced styling & interactive comp…
Jul 19, 2022
67346a7
Merge pull request #1 from Snoyark/master
ytlee93 Jul 20, 2022
7c2b0c3
add functions that generate html components and style selectors
Jul 20, 2022
41d2453
inject graph data to DashVisualizer task
Jul 21, 2022
e6078a9
Merge pull request #4 from ytlee93/master
ytlee93 Jul 26, 2022
b74e861
test_lineage_visualize.py created
Jul 26, 2022
0b35553
Merge pull request #2 from Snoyark/master
ytlee93 Jul 27, 2022
b6b5ee4
PyvisVisualizer added
Jul 25, 2022
794fb57
modify options
Jul 25, 2022
baeaace
change: change visualization to using pyvis library
Jul 27, 2022
c3d2ff7
Merge branch 'master' into large-graph-test
Jul 27, 2022
578acdf
pyvis import issue on running lineage test
Jul 27, 2022
9171e4e
import visualization modules using get_module()
Jul 27, 2022
d679f4a
test_wide_graphs added
Jul 28, 2022
3bab76a
used get_module() method for import & code style change
Jul 28, 2022
5c89c09
long graph visualize test added
Jul 28, 2022
5609e42
test_get_visualization_elements added
Jul 29, 2022
db9c3a3
Merge pull request #5 from ytlee93/master
ytlee93 Jul 29, 2022
09264c2
Merge pull request #3 from Snoyark/master
ytlee93 Jul 29, 2022
fa7b9dd
create context & action added to helper
Jul 29, 2022
83964da
resolve conflict with master branch
Jul 29, 2022
24f8925
merge integ load test
Jul 29, 2022
c66edf8
change: add queryLineageResult visualizer load test & integ test
Aug 1, 2022
7cec38d
remove generated graph html file after visualize integ test
Aug 1, 2022
73f2d4f
resolve integ test conflict
Aug 2, 2022
628ba0f
__str__ function update
Aug 2, 2022
f9d0ae1
query lineage result str function test added
Aug 2, 2022
c1169be
validation logic clean on integ tests
Aug 3, 2022
23fe126
sleep time before clean_all added (avoid race condition)
Aug 3, 2022
7b2bcf1
Merge pull request #6 from ytlee93/master
ytlee93 Aug 3, 2022
4b2e043
Merge pull request #4 from Snoyark/master
ytlee93 Aug 3, 2022
9b5819d
Merge branch 'unit-test'
Aug 3, 2022
09c9fc1
change: add queryLineageResult visualizer unit test
Aug 3, 2022
684d45d
startarn added to lineage return value
Aug 4, 2022
99027e3
Merge pull request #7 from ytlee93/master
ytlee93 Aug 5, 2022
32fe4fe
Merge pull request #5 from Snoyark/master
ytlee93 Aug 5, 2022
2950b9f
documentation: add visualize & PyvisVisualizer documentation
Aug 8, 2022
143143d
doc: install pyvis before using visualize()
Aug 9, 2022
169dd30
Merge pull request #8 from ytlee93/master
ytlee93 Aug 9, 2022
0878f34
Merge pull request #6 from Snoyark/master
ytlee93 Aug 9, 2022
f54e1b6
graph style fine-tune
Aug 9, 2022
a0be23e
Merge remote-tracking branch 'origin/master'
Aug 9, 2022
ff136c1
query visualize more info on hover node
Aug 9, 2022
1a3b5f3
info on hover
Aug 10, 2022
a9e5114
split generate html file & display
Aug 11, 2022
c1be765
change: lineage query visualization experience enhancement
Aug 12, 2022
e119009
generate legend divs programmatically
Aug 12, 2022
f761a98
Merge pull request #9 from ytlee93/master
ytlee93 Aug 15, 2022
8d3ca3f
Merge branch 'master' into lineageVisualization
jkasiraj Nov 7, 2022
2ac472a
fix: remove no-else-return block in _get_legend_line
Nov 16, 2022
1d3cdb3
Merge branch 'master' into lineageVisualization
jkasiraj Nov 17, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,5 +30,6 @@ env/
.vscode/
**/tmp
.python-version
*.html
**/_repack_model.py
**/_repack_script_launcher.sh
**/_repack_script_launcher.sh
1 change: 1 addition & 0 deletions requirements/extras/test_requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,5 @@ fabric==2.6.0
requests==2.27.1
sagemaker-experiments==0.1.35
Jinja2==3.0.3
pyvis==0.2.1
pandas>=1.3.5,<1.5
Loading