Tutorials (original) (raw)
Navigation Menu
Appearance settings
- AI CODE CREATION
* GitHub CopilotWrite better code with AI
* GitHub Copilot appDirect agents from issue to merge
* MCP RegistryNewIntegrate external tools - DEVELOPER WORKFLOWS
* ActionsAutomate any workflow
* CodespacesInstant dev environments
* IssuesPlan and track work
* Code ReviewManage code changes - APPLICATION SECURITY
* GitHub Advanced SecurityFind and fix vulnerabilities
* Code securitySecure your code as you build
* Secret protectionStop leaks before they start - EXPLORE
* Why GitHub
* Documentation
* Blog
* Changelog
* Marketplace
- AI CODE CREATION
- BY COMPANY SIZE
* Enterprises
* Small and medium teams
* Startups
* Nonprofits - BY USE CASE
* App Modernization
* DevSecOps
* DevOps
* CI/CD
* View all use cases - BY INDUSTRY
* Healthcare
* Financial services
* Manufacturing
* Government
* View all industries
- BY COMPANY SIZE
- EXPLORE BY TOPIC
* AI
* Software Development
* DevOps
* Security
* View all topics - EXPLORE BY TYPE
* Customer stories
* Events & webinars
* Ebooks & reports
* Business insights
* GitHub Skills - SUPPORT & SERVICES
* Documentation
* Customer support
* Community forum
* Trust center
* Partners
- EXPLORE BY TOPIC
- COMMUNITY
* GitHub SponsorsFund open source developers - PROGRAMS
* Security Lab
* Maintainer Community
* Accelerator
* GitHub Stars
* Archive Program - REPOSITORIES
* Topics
* Trending
* Collections
- COMMUNITY
- Pricing
Provide feedback
We read every piece of feedback, and take your input very seriously.
Include my email address so I can be contacted
Saved searches
Use saved searches to filter your results more quickly
Appearance settings
microsoft / data-accelerator Public
Notifications You must be signed in to change notification settings
Additional navigation options
Rohit Agrawal - MSFT edited this page
Sep 30, 2019
Learn how to use Data Accelerator step by step and get started setting up your big data pipeline in minutes. Data Accelerator provides all the tools necessary to go from simple to complex requirements, all within easy-to-use portal.
To unleash the full power Data Accelerator, deploy to Azure and check the tutorials for cloud mode below. We have also enabled a "hello world" experience that you can try out locally by running a docker container. When running locally there are no dependencies on Azure, however, the functionality is very limited and only there to give you a very cursory overview of Data Accelerator. Deploy locally using these instructions and then check out the tutorials of local mode below.
will walk you through both, the local mode as well as the cloud mode, step by step.
Local mode:
- Running samples
- Create a pipeline locally with no cloud dependencies in 5 minutes!
- Set up simple alert without writing any code
- Set up aggregated alert without writing any code
- Output to disk
- Tagging - Simple Rules
- Tagging - Aggregate Rules
- SQL queries - More powerful queries using SQL
- Create new Metric chart
- Debug jobs using Spark logs
- Use Reference Data to augment streaming data
- Windowing functions
- Use UDF and UDAF in your code
- Customize the schema
- Scale docker host
Cloud mode:
- Create a pipeline in 5 minutes!
- Live Query - Save hours by validating query in seconds!
- Set up simple alert without writing any code
- Set up aggregate alert without writing any code
- Set up new outputs without writing any code
- Tagging - Simple Rules
- Tagging - Aggregate Rules
- Tagged data flowing to CosmosDB
- SQL Queries - More powerful queries using SQL
- Create new Metric chart
- Windowing functions
- Using Reference data
- Use UDF, UDAF, Azure Functions in your query
- Use Accumulator to store data in-memory for jobs
- Scale up a deployment
- Diagnose issues using Spark logs
- Diagnose issues using Telemetry
- Inviting others and Roles based access
- Generate custom data with the Simulator
- Customize a Cloud Deployment
- Use input EventHub/IotHub in a different tenant
- Local Cloud Debugging
- Schedule a batch job
- Output data to Azure SQL Database
- Run Data Accelerator Flows on Databricks
Wiki pages Pages 53
- Home
- Arm Parameters
- Azure deployment
- Cloud deployment
- Cloud Deployment On Linux
- Cloud Simulator
- Configuring the Arm template
- Create new metric
- Creating your first pipeline in 5 minutes!
- Data Accelerator
- Data Accelerator with Databricks
- Data Accumulator
- Diagnose issues using Telemetry
- FAQ
- Find Applications For Your Environment
- functions
- Inviting others and RBAC
- Live query
- Local Cloud Debugging
- Local create metric
- Local mode with Docker
- Local running sample
- Local Tutorial Add an Alert
- Local Tutorial Adding SQL to your flow and outputs to Metrics dashboard
- Local Tutorial Advanced Aggregate alerts
- Local Tutorial Creating your first Flow in local mode
- Local Tutorial Custom schema
- Local Tutorial Debugging using Spark logs
- Local Tutorial Extending with UDF UDAF custom code
- Local Tutorial Outputs to disk
- Local Tutorial Reference data
- Local Tutorial Scaling the docker host
- Local Tutorial Tag Aggregate to metrics
- Local Tutorial Tag Rules output to local file
- Output data to Azure SQL Database
- readme
- reference data
- Run Data Accelerator Flows on Databricks
- Scale
- Schedule batch job
- Set up aggregate alert
- Set up new outputs
- Set up simple alert
- Spark logs
- sql query
- Tagged data flowing to CosmosDB
- Tagging aggregate rules
- Tagging simple rules
- Tutorials
- Upgrade Existing Data Accelerator Environment to v1.1
- Upgrade Existing Data Accelerator Environment to v1.2
- Use Input in different tenant
- Windowing functions
Data Accelerator
Install
Docs