Commit e380654
SeaDatabricksClient: Add Metadata Commands (#593)
* [squash from exec-sea] bring over execution phase changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess test
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add docstring
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remvoe exec func in sea backend
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess files
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess models
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess sea backend tests
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* cleanup
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* re-introduce get_schema_desc
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove SeaResultSet
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* clean imports and attributes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* pass CommandId to ExecResp
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove changes in types
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add back essential types (ExecResponse, from_sea_state)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* fix fetch types
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* excess imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* reduce diff by maintaining logs
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* fix int test types
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* [squashed from exec-sea] init execution func
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove irrelevant changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove ResultSetFilter functionality
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove more irrelevant changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove more irrelevant changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* even more irrelevant changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove sea response as init option
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* exec test example scripts
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* formatting (black)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* [squashed from sea-exec] merge sea stuffs
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess removed docstring
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess changes in backend
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove accidentally removed _get_schema_desc
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove unnecessary init with sea_response tests
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* rmeove unnecessary changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* formatting (black)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* improved models and filters from cloudfetch-sea branch
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* filters stuff (align with JDBC)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* backend from cloudfetch-sea
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove filtering, metadata ops
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* raise NotImplementedErrror for metadata ops
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add metadata commands
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* formatting (black)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add metadata command unit tests
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* change to valid table name
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-necessary changes
covered by #588
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* simplify test module
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* logging -> debug level
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* change table name in log
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-necessary changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-necessary backend cahnges
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-needed GetChunksResponse
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-needed GetChunksResponse
only relevant in Fetch phase
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* reduce code duplication in response parsing
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* reduce code duplication
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* more clear docstrings
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* introduce strongly typed ChunkInfo
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove is_volume_operation from response
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add is_volume_op and more ResultData fields
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add test scripts
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* Revert "Merge branch 'sea-migration' into exec-models-sea"
This reverts commit 8bd12d8, reversing
changes made to 030edf8.
* Revert "Merge branch 'exec-models-sea' into exec-phase-sea"
This reverts commit be1997e, reversing
changes made to 37813ba.
* change logging level
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-necessary changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove excess changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove _get_schema_bytes (for now)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* redundant comments
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove fetch phase methods
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* reduce code repetititon + introduce gaps after multi line pydocs
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove unused imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* move description extraction to helper func
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* formatting (black)
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add more unit tests
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* streamline unit tests
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* test getting the list of allowed configurations
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* reduce diff
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* reduce diff
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* house constants in enums for readability and immutability
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* add note on hybrid disposition
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove redundant note on arrow_schema_bytes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove irrelevant changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-necessary test changes
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove un-necessary changes in thrift backend tests
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove unimplemented methods test
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove invalid import
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* better align queries with JDBC impl
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* line breaks after multi-line PRs
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove unused imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* fix: introduce ExecuteResponse import
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove unimplemented metadata methods test, un-necessary imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* introduce unit tests for metadata methods
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove verbosity in ResultSetFilter docstring
Co-authored-by: jayant <167047871+jayantsing-db@users.noreply.github.com>
* remove un-necessary info in ResultSetFilter docstring
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove explicit type checking, string literals around forward annotations
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* house SQL commands in constants
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove catalog requirement in get_tables
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* move filters.py to SEA utils
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* ensure SeaResultSet
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* prevent circular imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove unused imports
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove cast, throw error if not SeaResultSet
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* make SEA backend methods return SeaResultSet
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* use spec-aligned Exceptions in SEA backend
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
* remove defensive row type check
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
---------
Signed-off-by: varun-edachali-dbx <varun.edachali@databricks.com>
Co-authored-by: jayant <167047871+jayantsing-db@users.noreply.github.com>1 parent 59b4825 commit e380654
File tree
5 files changed
+708
-85
lines changed- src/databricks/sql/backend/sea
- utils
- tests/unit
5 files changed
+708
-85
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
1 | 3 | | |
2 | 4 | | |
3 | 5 | | |
| |||
10 | 12 | | |
11 | 13 | | |
12 | 14 | | |
| 15 | + | |
13 | 16 | | |
14 | 17 | | |
15 | 18 | | |
16 | 19 | | |
17 | | - | |
| 20 | + | |
18 | 21 | | |
19 | 22 | | |
20 | 23 | | |
| |||
24 | 27 | | |
25 | 28 | | |
26 | 29 | | |
27 | | - | |
| 30 | + | |
28 | 31 | | |
29 | 32 | | |
30 | 33 | | |
| |||
169 | 172 | | |
170 | 173 | | |
171 | 174 | | |
172 | | - | |
| 175 | + | |
173 | 176 | | |
174 | 177 | | |
175 | 178 | | |
| |||
241 | 244 | | |
242 | 245 | | |
243 | 246 | | |
244 | | - | |
| 247 | + | |
245 | 248 | | |
246 | 249 | | |
247 | 250 | | |
248 | 251 | | |
249 | 252 | | |
250 | 253 | | |
251 | | - | |
| 254 | + | |
252 | 255 | | |
253 | 256 | | |
254 | 257 | | |
| |||
400 | 403 | | |
401 | 404 | | |
402 | 405 | | |
403 | | - | |
| 406 | + | |
404 | 407 | | |
405 | 408 | | |
406 | 409 | | |
407 | 410 | | |
408 | | - | |
| 411 | + | |
409 | 412 | | |
410 | 413 | | |
411 | 414 | | |
| |||
426 | 429 | | |
427 | 430 | | |
428 | 431 | | |
429 | | - | |
| 432 | + | |
430 | 433 | | |
431 | 434 | | |
432 | 435 | | |
| |||
501 | 504 | | |
502 | 505 | | |
503 | 506 | | |
504 | | - | |
| 507 | + | |
505 | 508 | | |
506 | 509 | | |
507 | 510 | | |
508 | | - | |
| 511 | + | |
509 | 512 | | |
510 | 513 | | |
511 | 514 | | |
| |||
524 | 527 | | |
525 | 528 | | |
526 | 529 | | |
527 | | - | |
| 530 | + | |
528 | 531 | | |
529 | 532 | | |
530 | 533 | | |
531 | | - | |
| 534 | + | |
532 | 535 | | |
533 | 536 | | |
534 | 537 | | |
| |||
550 | 553 | | |
551 | 554 | | |
552 | 555 | | |
553 | | - | |
| 556 | + | |
554 | 557 | | |
555 | 558 | | |
556 | 559 | | |
| |||
572 | 575 | | |
573 | 576 | | |
574 | 577 | | |
575 | | - | |
576 | | - | |
| 578 | + | |
| 579 | + | |
577 | 580 | | |
578 | 581 | | |
579 | 582 | | |
| |||
582 | 585 | | |
583 | 586 | | |
584 | 587 | | |
585 | | - | |
| 588 | + | |
586 | 589 | | |
587 | 590 | | |
588 | 591 | | |
589 | 592 | | |
590 | 593 | | |
591 | 594 | | |
592 | | - | |
| 595 | + | |
593 | 596 | | |
594 | 597 | | |
595 | 598 | | |
| |||
626 | 629 | | |
627 | 630 | | |
628 | 631 | | |
629 | | - | |
630 | | - | |
631 | | - | |
632 | | - | |
| 632 | + | |
| 633 | + | |
| 634 | + | |
| 635 | + | |
| 636 | + | |
| 637 | + | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
| 642 | + | |
| 643 | + | |
| 644 | + | |
| 645 | + | |
| 646 | + | |
| 647 | + | |
| 648 | + | |
633 | 649 | | |
634 | 650 | | |
635 | 651 | | |
636 | 652 | | |
637 | 653 | | |
638 | 654 | | |
639 | | - | |
| 655 | + | |
640 | 656 | | |
641 | 657 | | |
642 | | - | |
643 | | - | |
644 | | - | |
| 658 | + | |
| 659 | + | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
| 664 | + | |
| 665 | + | |
| 666 | + | |
| 667 | + | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
| 671 | + | |
| 672 | + | |
| 673 | + | |
| 674 | + | |
| 675 | + | |
| 676 | + | |
| 677 | + | |
| 678 | + | |
| 679 | + | |
| 680 | + | |
| 681 | + | |
645 | 682 | | |
646 | 683 | | |
647 | 684 | | |
648 | 685 | | |
649 | 686 | | |
650 | 687 | | |
651 | | - | |
| 688 | + | |
652 | 689 | | |
653 | 690 | | |
654 | 691 | | |
655 | 692 | | |
656 | | - | |
657 | | - | |
658 | | - | |
| 693 | + | |
| 694 | + | |
| 695 | + | |
| 696 | + | |
| 697 | + | |
| 698 | + | |
| 699 | + | |
| 700 | + | |
| 701 | + | |
| 702 | + | |
| 703 | + | |
| 704 | + | |
| 705 | + | |
| 706 | + | |
| 707 | + | |
| 708 | + | |
| 709 | + | |
| 710 | + | |
| 711 | + | |
| 712 | + | |
| 713 | + | |
| 714 | + | |
| 715 | + | |
| 716 | + | |
| 717 | + | |
| 718 | + | |
| 719 | + | |
| 720 | + | |
| 721 | + | |
| 722 | + | |
| 723 | + | |
| 724 | + | |
| 725 | + | |
| 726 | + | |
| 727 | + | |
| 728 | + | |
659 | 729 | | |
660 | 730 | | |
661 | 731 | | |
662 | 732 | | |
663 | 733 | | |
664 | 734 | | |
665 | | - | |
| 735 | + | |
666 | 736 | | |
667 | 737 | | |
668 | 738 | | |
669 | 739 | | |
670 | | - | |
671 | | - | |
672 | | - | |
| 740 | + | |
| 741 | + | |
| 742 | + | |
| 743 | + | |
| 744 | + | |
| 745 | + | |
| 746 | + | |
| 747 | + | |
| 748 | + | |
| 749 | + | |
| 750 | + | |
| 751 | + | |
| 752 | + | |
| 753 | + | |
| 754 | + | |
| 755 | + | |
| 756 | + | |
| 757 | + | |
| 758 | + | |
| 759 | + | |
| 760 | + | |
| 761 | + | |
| 762 | + | |
| 763 | + | |
| 764 | + | |
| 765 | + | |
| 766 | + | |
| 767 | + | |
| 768 | + | |
| 769 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
0 commit comments