Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit history

Commits on Nov 30, 2016

• [SPARK-18516][STRUCTURED STREAMING] Follow up PR to add StreamingQuery.status to Python

  Show description for bc09a2b
  tdas

  committed
  bc09a2bView commit details

  Copy full SHA for bc09a2b

  View code at this pointBrowse repository at this point

• [SPARK-18516][SQL] Split state and progress in streaming

  Show description for c3d08e2
  

  tdas

  authored and

  marmbrus

  committed
  c3d08e2View commit details

  Copy full SHA for c3d08e2

  View code at this pointBrowse repository at this point

Commits on Nov 22, 2016

• [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`/`Note that` across Python API documentation

  Show description for 933a654
  

  HyukjinKwon

  authored and

  srowen

  committed
  933a654View commit details

  Copy full SHA for 933a654

  View code at this pointBrowse repository at this point

• [SPARK-18493] Add missing python APIs: withWatermark and checkpoint to dataframe

  Show description for 97a8239
  

  brkyvz

  authored and

  zsxwing

  committed
  97a8239View commit details

  Copy full SHA for 97a8239

  View code at this pointBrowse repository at this point

Commits on Nov 17, 2016

• [SPARK-18365][DOCS] Improve Sample Method Documentation

  Show description for 49b6f45
  

  bllchmbrs

  authored and

  srowen

  committed
  49b6f45View commit details

  Copy full SHA for 49b6f45

  View code at this pointBrowse repository at this point

Commits on Nov 16, 2016

• [SPARK-18459][SPARK-18460][STRUCTUREDSTREAMING] Rename triggerId to batchId and add triggerDetails to json in StreamingQueryStatus

  Show description for 0048ce7
  

  tdas

  authored and

  zsxwing

  committed
  0048ce7View commit details

  Copy full SHA for 0048ce7

  View code at this pointBrowse repository at this point

Commits on Nov 9, 2016

• [SPARK-17829][SQL] Stable format for offset log

  Show description for 3f62e1b
  

  tcondie

  authored and

  zsxwing

  committed
  3f62e1bView commit details

  Copy full SHA for 3f62e1b

  View code at this pointBrowse repository at this point

Commits on Nov 6, 2016

• [MINOR][DOCUMENTATION] Fix some minor descriptions in functions consistently with expressions

  Show description for 15d3926
  

  HyukjinKwon

  authored and

  Felix Cheung

  committed
  15d3926View commit details

  Copy full SHA for 15d3926

  View code at this pointBrowse repository at this point

Commits on Nov 4, 2016

• [SPARK-14393][SQL][DOC] update doc for python and R

  Show description for a08463b
  

  felixcheung

  authored and

  Felix Cheung

  committed
  a08463bView commit details

  Copy full SHA for a08463b

  View code at this pointBrowse repository at this point

Commits on Nov 1, 2016

• [SPARK-17764][SQL] Add `to_json` supporting to convert nested struct column to JSON string

  Show description for 01dd008
  

  HyukjinKwon

  authored and

  marmbrus

  committed
  01dd008View commit details

  Copy full SHA for 01dd008

  View code at this pointBrowse repository at this point

Commits on Oct 27, 2016

• [SQL][DOC] updating doc for JSON source to link to jsonlines.org

  Show description for 44c8bfd
  

  felixcheung

  authored and

  Felix Cheung

  committed
  44c8bfdView commit details

  Copy full SHA for 44c8bfd

  View code at this pointBrowse repository at this point

Commits on Oct 21, 2016

• [SPARK-17926][SQL][STREAMING] Added json for statuses

  Show description for 7a531e3
  

  tdas

  authored and

  yhuai

  committed
  7a531e3View commit details

  Copy full SHA for 7a531e3

  View code at this pointBrowse repository at this point

Commits on Oct 15, 2016

• [SPARK-17946][PYSPARK] Python crossJoin API similar to Scala

  Show description for 2d96d35
  

  srinathshankar

  authored and

  rxin

  committed
  2d96d35View commit details

  Copy full SHA for 2d96d35

  View code at this pointBrowse repository at this point

Commits on Oct 14, 2016

• [SPARK-11775][PYSPARK][SQL] Allow PySpark to register Java UDF

  Show description for f00df40
  

  zjffdu

  authored and

  marmbrus

  committed
  f00df40View commit details

  Copy full SHA for f00df40

  View code at this pointBrowse repository at this point

• [SPARK-16063][SQL] Add storageLevel to Dataset

  Show description for 5aeb738
  

  Nick Pentreath

  authored and

  marmbrus

  committed
  5aeb738View commit details

  Copy full SHA for 5aeb738

  View code at this pointBrowse repository at this point

Commits on Oct 13, 2016

• [SPARK-17731][SQL][STREAMING] Metrics for structured streaming

  Show description for 7106866
  tdas

  committed
  7106866View commit details

  Copy full SHA for 7106866

  View code at this pointBrowse repository at this point

Commits on Oct 12, 2016

• [SPARK-17845] [SQL] More self-evident window function frame boundary API

  Show description for 6f20a92
  

  rxin

  authored and

  davies

  committed
  6f20a92View commit details

  Copy full SHA for 6f20a92

  View code at this pointBrowse repository at this point

• [SPARK-14761][SQL] Reject invalid join methods when join columns are not specified in PySpark DataFrame join.

  Show description for 8880fd1
  

  Bijay Pathak

  authored and

  rxin

  committed
  8880fd1View commit details

  Copy full SHA for 8880fd1

  View code at this pointBrowse repository at this point

• [SPARK-17720][SQL] introduce static SQL conf

  Show description for b9a1471
  

  cloud-fan

  authored and

  gatorsmile

  committed
  b9a1471View commit details

  Copy full SHA for b9a1471

  View code at this pointBrowse repository at this point

Commits on Oct 11, 2016

• [SPARK-17338][SQL][FOLLOW-UP] add global temp view

  Show description for 7388ad9
  cloud-fan

  committed
  7388ad9View commit details

  Copy full SHA for 7388ad9

  View code at this pointBrowse repository at this point

• [SPARK-17808][PYSPARK] Upgraded version of Pyrolite to 4.13

  Show description for 658c714
  

  BryanCutler

  authored and

  srowen

  committed
  658c714View commit details

  Copy full SHA for 658c714

  View code at this pointBrowse repository at this point

• [SPARK-17844] Simplify DataFrame API for defining frame boundaries in window functions

  Show description for b515768
  

  rxin

  authored and

  hvanhovell

  committed
  b515768View commit details

  Copy full SHA for b515768

  View code at this pointBrowse repository at this point

Commits on Oct 10, 2016

• [SPARK-17338][SQL] add global temp view

  Show description for 23ddff4
  cloud-fan

  committed
  23ddff4View commit details

  Copy full SHA for 23ddff4

  View code at this pointBrowse repository at this point

Commits on Oct 7, 2016

• [SPARK-16960][SQL] Deprecate approxCountDistinct, toDegrees and toRadians according to FunctionRegistry

  Show description for 2b01d3c
  

  HyukjinKwon

  authored and

  srowen

  committed
  2b01d3cView commit details

  Copy full SHA for 2b01d3c

  View code at this pointBrowse repository at this point

• [SPARK-17805][PYSPARK] Fix in sqlContext.read.text when pass in list of paths

  Show description for bcaa799
  

  BryanCutler

  authored and

  rxin

  committed
  bcaa799View commit details

  Copy full SHA for bcaa799

  View code at this pointBrowse repository at this point

Commits on Sep 29, 2016

• [SPARK-17699] Support for parsing JSON string columns

  Show description for fe33121
  

  marmbrus

  authored and

  yhuai

  committed
  fe33121View commit details

  Copy full SHA for fe33121

  View code at this pointBrowse repository at this point

Commits on Sep 28, 2016

• [MINOR][PYSPARK][DOCS] Fix examples in PySpark documentation

  Show description for 2190037
  

  HyukjinKwon

  authored and

  srowen

  committed
  2190037View commit details

  Copy full SHA for 2190037

  View code at this pointBrowse repository at this point

Commits on Sep 21, 2016

• [SPARK-17583][SQL] Remove uesless rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV

  Show description for 25a020b
  

  HyukjinKwon

  authored and

  srowen

  committed
  25a020bView commit details

  Copy full SHA for 25a020b

  View code at this pointBrowse repository at this point

Commits on Sep 19, 2016

• [SPARK-17100] [SQL] fix Python udf in filter on top of outer join

  Show description for d810415
  

  Davies Liu

  authored and

  davies

  committed
  d810415View commit details

  Copy full SHA for d810415

  View code at this pointBrowse repository at this point

Commits on Sep 18, 2016

• [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV cast null values properly

  Show description for 1dbb725
  

  lw-lin

  authored and

  srowen

  committed
  1dbb725View commit details

  Copy full SHA for 1dbb725

  View code at this pointBrowse repository at this point

Commits on Sep 14, 2016

• [SPARK-17514] df.take(1) and df.limit(1).collect() should perform the same in Python

  Show description for 6d06ff6
  

  JoshRosen

  authored and

  davies

  committed
  6d06ff6View commit details

  Copy full SHA for 6d06ff6

  View code at this pointBrowse repository at this point

Commits on Sep 12, 2016

• [SPARK-17474] [SQL] fix python udf in TakeOrderedAndProjectExec

  Show description for a91ab70
  

  Davies Liu

  authored and

  davies

  committed
  a91ab70View commit details

  Copy full SHA for a91ab70

  View code at this pointBrowse repository at this point

Commits on Sep 2, 2016

• [SPARK-17298][SQL] Require explicit CROSS join for cartesian products

  Show description for e6132a6
  

  srinathshankar

  authored and

  hvanhovell

  committed
  e6132a6View commit details

  Copy full SHA for e6132a6

  View code at this pointBrowse repository at this point

• [SPARK-17261] [PYSPARK] Using HiveContext after re-creating SparkContext in Spark 2.0 throws "Java.lang.illegalStateException: Cannot call methods on a stopped sparkContext"

  Show description for ea66228
  

  zjffdu

  authored and

  davies

  committed
  ea66228View commit details

  Copy full SHA for ea66228

  View code at this pointBrowse repository at this point

Commits on Aug 30, 2016

• [SPARK-17264][SQL] DataStreamWriter should document that it only supports Parquet for now

  Show description for befab9c
  srowen

  committed
  befab9cView commit details

  Copy full SHA for befab9c

  View code at this pointBrowse repository at this point