Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit history

Commits on Aug 23, 2019

• [SPARK-28858][ML][PYSPARK] add tree-based transformation in the py side

  Show description for 573b1cb
  

  zhengruifeng

  authored and

  BryanCutler

  committed
  573b1cbView commit details

  Copy full SHA for 573b1cb

  View code at this pointBrowse repository at this point

Commits on Aug 22, 2019

• [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state

  Show description for fb1f868
  

  helenyuyu

  authored and

  srowen

  committed
  fb1f868View commit details

  Copy full SHA for fb1f868

  View code at this pointBrowse repository at this point

Commits on Aug 20, 2019

• [SPARK-28777][PYTHON][DOCS] Fix format_string doc string with the correct parameters

  Show description for a787bc2
  

  darrentirto

  authored and

  dongjoon-hyun

  committed
  a787bc2View commit details

  Copy full SHA for a787bc2

  View code at this pointBrowse repository at this point

Commits on Aug 16, 2019

• [SPARK-28736][SPARK-28735][PYTHON][ML] Fix PySpark ML tests to pass in JDK 11

  Show description for ef14237
  HyukjinKwon

  committed
  ef14237View commit details

  Copy full SHA for ef14237

  View code at this pointBrowse repository at this point

Commits on Aug 15, 2019

• [SPARK-28243][PYSPARK][ML][FOLLOW-UP] Move Python DecisionTreeParams to regression.py

  Show description for ba5ee27
  

  huaxingao

  authored and

  srowen

  committed
  ba5ee27View commit details

  Copy full SHA for ba5ee27

  View code at this pointBrowse repository at this point

Commits on Aug 13, 2019

• [SPARK-28422][SQL][PYTHON] GROUPED_AGG pandas_udf should work without group by clause

  Show description for e6a0385
  

  viirya

  authored and

  HyukjinKwon

  committed
  e6a0385View commit details

  Copy full SHA for e6a0385

  View code at this pointBrowse repository at this point

• [SPARK-28698][SQL] Support user-specified output schema in `to_avro`

  Show description for 48adc91
  

  gengliangwang

  authored and

  cloud-fan

  committed
  48adc91View commit details

  Copy full SHA for 48adc91

  View code at this pointBrowse repository at this point

Commits on Aug 9, 2019

• [SPARK-27371][CORE] Support GPU-aware resources scheduling in Standalone

  Show description for cbad616
  

  Ngone51

  authored and

  tgravescs

  committed
  cbad616View commit details

  Copy full SHA for cbad616

  View code at this pointBrowse repository at this point

• [SPARK-28651][SS] Force the schema of Streaming file source to be nullable

  Show description for 5bb6994
  

  zsxwing

  authored and

  HyukjinKwon

  committed
  5bb6994View commit details

  Copy full SHA for 5bb6994

  View code at this pointBrowse repository at this point

Commits on Aug 8, 2019

• [SPARK-28454][PYTHON] Validate LongType in `createDataFrame(verifySchema=True)`

  Show description for bda5b51
  

  simplylizz

  authored and

  HyukjinKwon

  committed
  bda5b51View commit details

  Copy full SHA for bda5b51

  View code at this pointBrowse repository at this point

Commits on Aug 5, 2019

• [SPARK-28486][CORE][PYTHON] Map PythonBroadcast's data file to a BroadcastBlock to avoid delete by GC

  Show description for 94499af
  

  Ngone51

  authored and

  HyukjinKwon

  committed
  94499afView commit details

  Copy full SHA for 94499af

  View code at this pointBrowse repository at this point

Commits on Aug 3, 2019

• [SPARK-28582][PYTHON] Fix flaky test DaemonTests.do_termination_test which fail on Python 3.7

  Show description for b3394db
  

  WeichenXu123

  authored and

  HyukjinKwon

  committed
  b3394dbView commit details

  Copy full SHA for b3394db

  View code at this pointBrowse repository at this point

Commits on Aug 2, 2019

• Revert "[SPARK-28582][PYSPARK] Fix flaky test DaemonTests.do_termination_test which fail on Python 3.7"

  Show description for 8ae032d
  dongjoon-hyun

  committed
  8ae032dView commit details

  Copy full SHA for 8ae032d

  View code at this pointBrowse repository at this point

• [SPARK-23469][ML] HashingTF should use corrected MurmurHash3 implementation

  Show description for 660423d
  

  huaxingao

  authored and

  srowen

  committed
  660423dView commit details

  Copy full SHA for 660423d

  View code at this pointBrowse repository at this point

• [SPARK-28582][PYSPARK] Fix flaky test DaemonTests.do_termination_test which fail on Python 3.7

  Show description for fbeee0c
  

  WeichenXu123

  authored and

  HyukjinKwon

  committed
  fbeee0cView commit details

  Copy full SHA for fbeee0c

  View code at this pointBrowse repository at this point

Commits on Jul 31, 2019

• [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

  Show description for b8e13b0
  

  HyukjinKwon

  authored and

  cloud-fan

  committed
  b8e13b0View commit details

  Copy full SHA for b8e13b0

  View code at this pointBrowse repository at this point

• [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

  Show description for a745381
  

  WeichenXu123

  authored and

  HyukjinKwon

  committed
  a745381View commit details

  Copy full SHA for a745381

  View code at this pointBrowse repository at this point

• [SPARK-26175][PYTHON] Redirect the standard input of the forked child to devnull in daemon

  Show description for 3b14088
  

  WeichenXu123

  authored and

  HyukjinKwon

  committed
  3b14088View commit details

  Copy full SHA for 3b14088

  View code at this pointBrowse repository at this point

Commits on Jul 30, 2019

• [SPARK-28399][ML][PYTHON] implement RobustScaler

  Show description for 44c28d7
  

  zhengruifeng

  authored and

  srowen

  committed
  44c28d7View commit details

  Copy full SHA for 44c28d7

  View code at this pointBrowse repository at this point

Commits on Jul 29, 2019

• [SPARK-28471][SQL] Replace `yyyy` by `uuuu` in date-timestamp patterns without era

  Show description for a5a5da7
  

  MaxGekk

  authored and

  dongjoon-hyun

  committed
  a5a5da7View commit details

  Copy full SHA for a5a5da7

  View code at this pointBrowse repository at this point

Commits on Jul 28, 2019

• [SPARK-21481][ML] Add indexOf method in ml.feature.HashingTF

  Show description for 70f82fd
  

  huaxingao

  authored and

  srowen

  committed
  70f82fdView commit details

  Copy full SHA for 70f82fd

  View code at this pointBrowse repository at this point

Commits on Jul 27, 2019

• [MINOR][PYTHON] Use `_memory_limit` to get worker memory conf in `rdd.py`

  Show description for fbaa177
  

  WangGuangxin

  authored and

  dongjoon-hyun

  committed
  fbaa177View commit details

  Copy full SHA for fbaa177

  View code at this pointBrowse repository at this point

Commits on Jul 26, 2019

• [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

  Show description for 3de4e1b
  

  huaxingao

  authored and

  srowen

  committed
  3de4e1bView commit details

  Copy full SHA for 3de4e1b

  View code at this pointBrowse repository at this point

Commits on Jul 20, 2019

• [SPARK-28243][PYSPARK][ML] Remove setFeatureSubsetStrategy and setSubsamplingRate from Python TreeEnsembleParams

  Show description for 72c80ee
  

  huaxingao

  authored and

  srowen

  committed
  72c80eeView commit details

  Copy full SHA for 72c80ee

  View code at this pointBrowse repository at this point

Commits on Jul 18, 2019

• [SPARK-28439][PYTHON][SQL] Add support for count: Column in array_repeat

  Show description for a0c2fa6
  

  zero323

  authored and

  dongjoon-hyun

  committed
  a0c2fa6View commit details

  Copy full SHA for a0c2fa6

  View code at this pointBrowse repository at this point

• [SPARK-28411][PYTHON][SQL] InsertInto with overwrite is not honored

  Show description for 971e832
  

  huaxingao

  authored and

  HyukjinKwon

  committed
  971e832View commit details

  Copy full SHA for 971e832

  View code at this pointBrowse repository at this point

• [SPARK-27609][PYTHON] Convert values of function options to strings

  Show description for 70073b1
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  70073b1View commit details

  Copy full SHA for 70073b1

  View code at this pointBrowse repository at this point

Commits on Jul 17, 2019

• [SPARK-28418][PYTHON][SQL] Wait for event process in 'test_query_execution_listener_on_collect'

  Show description for 66179fa
  HyukjinKwon

  committed
  66179faView commit details

  Copy full SHA for 66179fa

  View code at this pointBrowse repository at this point

Commits on Jul 15, 2019

• [SPARK-28381][PYSPARK] Upgraded version of Pyrolite to 4.30

  Show description for 591de42
  

  viirya

  authored and

  HyukjinKwon

  committed
  591de42View commit details

  Copy full SHA for 591de42

  View code at this pointBrowse repository at this point

Commits on Jul 14, 2019

• [SPARK-28378][PYTHON] Remove usage of cgi.escape

  Show description for 707411f
  

  viirya

  authored and

  HyukjinKwon

  committed
  707411fView commit details

  Copy full SHA for 707411f

  View code at this pointBrowse repository at this point

Commits on Jul 13, 2019

• [SPARK-28355][CORE][PYTHON] Use Spark conf for threshold at which command is compressed by broadcast

  Show description for 79e2047
  

  jessecai

  authored and

  gatorsmile

  committed
  79e2047View commit details

  Copy full SHA for 79e2047

  View code at this pointBrowse repository at this point

Commits on Jul 11, 2019

• [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources

  Show description for f84cca2
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  f84cca2View commit details

  Copy full SHA for f84cca2

  View code at this pointBrowse repository at this point

Commits on Jul 10, 2019

• [SPARK-28323][SQL][PYTHON] PythonUDF should be able to use in join condition

  Show description for 7858e53
  

  viirya

  authored and

  BryanCutler

  committed
  7858e53View commit details

  Copy full SHA for 7858e53

  View code at this pointBrowse repository at this point

Commits on Jul 9, 2019

• [SPARK-28140][MLLIB][PYTHON] Accept DataFrames in RowMatrix and IndexedRowMatrix constructors

  Show description for a32c92c
  

  henrydavidge

  authored and

  srowen

  committed
  a32c92cView commit details

  Copy full SHA for a32c92c

  View code at this pointBrowse repository at this point

• [SPARK-28273][SQL][PYTHON] Convert and port 'pgSQL/case.sql' into UDF test base

  Show description for fe3e34d
  

  HyukjinKwon

  authored and

  cloud-fan

  committed
  fe3e34dView commit details

  Copy full SHA for fe3e34d

  View code at this pointBrowse repository at this point