You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|**On-cluster batch processing**|| 1. [Spark](https://spark.apache.org) (see [Spark Interop with Geni](#spark_interop_with_geni) below) ||
48
-
|**On-cluster stream processing**|| 2. [Kafka Streams](https://kafka.apache.org/documentation/streams) (see [Kafka Interop with Jackdaw](#kafka_interop_with_jackdaw) below) | 3. [Spark Structured Streaming](https://spark.apache.org/streaming),\<br\>4. [Flink](https://flink.apache.org)|
49
-
|**On-cluster batch and stream processing**||| 5. [Databricks](https://databricks.com) (see [Spark Interop with Geni](#spark_interop_with_geni) below),\<br\>6. [Snowflake](https://snowflake.com) (see [Snowflake Interop](#snowflake_interop_with_a_new_clojure_api!) below) |
48
+
|**On-cluster stream processing**|| 2. [Kafka Streams](https://kafka.apache.org/documentation/streams) (see [Kafka Interop with Jackdaw](#kafka_interop_with_jackdaw) below) | 3. [Spark Structured Streaming](https://spark.apache.org/streaming),<br>4. [Flink](https://flink.apache.org)|
49
+
|**On-cluster batch and stream processing**||| 5. [Databricks](https://databricks.com) (see [Spark Interop with Geni](#spark_interop_with_geni) below),<br>6. [Snowflake](https://snowflake.com) (see [Snowflake Interop](#snowflake_interop_with_a_new_clojure_api!) below) |
50
50
51
51
Please note, I don't wish to make any critical judgments based on either the summary analysis above or the more detailed analysis below. The goal is to understand the situation with respect to Clojure support and highlight any gaps, although I suppose I am also inadvertently highlighting the difficulties of maintaining open source software!
52
52
@@ -63,8 +63,9 @@ However, I found a number of issues that would need to be addressed in order to
63
63
1. Problems with [support for Databricks](https://github.com/zero-one-group/geni/issues/356), although I suspect this is related to point 1.
64
64
65
65
Also, in general by my criteria the support classification is "support unknown":
1. Version [0.0.42 api docs broken](https://cljdoc.org/d/zero.one/geni/0.0.42/doc/readme%20%20https://cljdoc.org/builds/73977), also affects version 0.0.41
68
+
1. Version [0.0.42 api docs](https://cljdoc.org/d/zero.one/geni/0.0.42/doc/readme) are [broken](https://cljdoc.org/builds/73977), also affects version 0.0.41
68
69
1. No commits since November 2023.
69
70
1. No releases since November 2023.
70
71
1. No PRs accepted or rejected since November 2023.
@@ -82,9 +83,9 @@ Also, in general by my criteria the support classification is "support unknown":
82
83
83
84
### Snowflake Interop with a New Clojure API!
84
85
85
-
Although the [Snowpark](https://docs.snowflake.com/en/developer-guide/snowpark/java) library has Java and Scala bindings, it doesn't provide anything for Clojure. As such, it's currently not possible to interact with Snowflake using the Clojure way.
86
+
Although the [Snowpark](https://docs.snowflake.com/en/developer-guide/snowpark/java/index) library has Java and Scala bindings, it doesn't provide anything for Clojure. As such, it's currently not possible to interact with Snowflake using the Clojure way.
86
87
87
-
To address this gap, I decided to try my hand at creating a [Clojure API for Snowflake](https://github.com/alza-bitz/snowflake-clj) as part of a broader effort to improve the overall situation regarding Clojure support for popular data tools.
88
+
To address this gap, I decided to try my hand at creating a [Clojure API for Snowflake](https://github.com/alza-bitz/snowpark-clj) as part of a broader effort to improve the overall situation regarding Clojure support for popular data tools.
88
89
89
90
The aim is to validate this approach as a foundation for enabling a wide range of data science or data engineering use cases from the Clojure REPL, in situations where Snowflake is the data warehouse of choice.
0 commit comments