[SPARK-4969] Add binaryRecords support to streaming (original) (raw)

Log inSkip to main contentSkip to sidebar

• Dashboards

• Projects

• Issues

• Help

  • Jira Core help
  • Keyboard Shortcuts
  • About Jira
  • Jira Credits

• Log In

1. Spark
2. SPARK-4969

XMLWordPrintableJSON

Details

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.2.0

Description

As of Spark 1.2 there is support for loading fixed length records from flat binary files. This is a useful way to load dense numerical array data into Spark, especially in scientific computing applications.

We should add support for loading this same file type in Spark Streaming, both in Scala/Java and in Python.

Attachments

Issue Links

Activity

People

Votes:

0 Vote for this issue

Watchers:

2 Start watching this issue

Dates

Created:

25/Dec/14 18:24

Updated:

04/Feb/15 06:25

Resolved:

04/Feb/15 06:25