Apache Spark
![spark logo](https://webcf.waybackmachine.org/web/20211017131101im_/https://raw.githubusercontent.com/github/explore/6f5025830918df26b37d23b3ffffbc35725fe15f/topics/spark/spark.png)
Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.
Here are 6,036 public repositories matching this topic...
-
Updated
May 13, 2021 - Python
-
Updated
Oct 15, 2021 - Python
-
Updated
Sep 19, 2021 - Go
-
Updated
Oct 16, 2021 - Python
Describe the bug
Using a time dimension on a runningTotal measure on Snowflake mixes quoted and unquoted columns in the query. This fails the query, because Snowflake has specific rules about quoted columns. Specifically:
- All unquoted column names are treated as upper case
- Quoted column names are case sensitive.
So "date_from" <> date_from
To Reproduce
Steps to reproduce
-
Updated
Oct 8, 2021 - Java
-
Updated
Oct 8, 2021
-
Updated
Oct 31, 2019
-
Updated
Oct 14, 2021 - Java
-
Updated
Oct 17, 2021 - Jupyter Notebook
-
Updated
Dec 23, 2020 - Python
-
Updated
Oct 16, 2021 - Java
-
Updated
Apr 24, 2020 - Jsonnet
-
Updated
Sep 21, 2021 - Scala
-
Updated
Oct 15, 2021 - Python
Could we clarify that delta-log files are JSON line-delimited files in https://github.com/delta-io/delta/blob/master/PROTOCOL.md#delta-log-entries ?
In the PROTOCOL.md file it is not clear what is the format of JSON. Every delta-log entry file is "new-line delimited json file", but this is not specified in this file. Protocol do not explicitly specify that every action is stored as a single-lin
-
Updated
May 26, 2019 - Scala
-
Updated
Mar 31, 2021 - JavaScript
-
Updated
May 12, 2021 - Jupyter Notebook
Used Spark version
Spark Version: 2.4.4
Used Spark Job Server version
SJS version: v0.11.1
Deployed mode
client on Spark Standalone
Actual (wrong) behavior
I can't get config, when post a job with 'sync=true'. I got it:
http://localhost:8090/jobs/ff99479b-e59c-4215-b17d-4058f8d97d25/config
{"status":"ERROR","result":"No such job ID ff99479b-e59c-4215-b17d-4058f8d97d25"
I have a simple regression task (using a LightGBMRegressor) where I want to penalize negative predictions more than positive ones. Is there a way to achieve this with the default regression LightGBM objectives (see https://lightgbm.readthedocs.io/en/latest/Parameters.html)? If not, is it somehow possible to define (many example for default LightGBM model) and pass a custom regression objective?
-
Updated
Oct 16, 2021 - Scala
Created by Matei Zaharia
Released May 26, 2014
- Repository
- apache/spark
- Website
- spark.apache.org
- Wikipedia
- Wikipedia
At this moment relu_layer op doesn't allow threshold configuration, and legacy RELU op allows that.
We should add configuration option to relu_layer.