Alec Judd
Articles
Recent activity by Alec Judd
-
Using Multiple Languages in a Databricks Notebook
Working With Multiple LanguagesYou will need to use a DataForge SDK supported language to run custom processes from your Databricks notebook. However, you are not limited to only using these langua...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
Resetting Processes
Types of ResetsDuring the development lifecycle, users will need to reset their sources often to change source settings, apply rules, update output tables, and restart failed processes. The followi...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
Rules
Rules allow DataForge to modify and transform data.Rules TabThe Rules tab allows users to select, edit, remove, or add a Source's Rules. By default, only Active Rules are listed. The Active Only to...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
DataForge Cloud 8.2 Version Features Blog
DataForge Cloud version 8.2 is here, providing GitHub integration support, role-based access control, dependency recommendations, and an improved user experience. Table of contents Project integra...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
Complex Data Types
DataForge supports the use of complex data types such as array and struct, common in semi-structured datasets (JSON), API results, and streaming. These data types are treated similarly to all other...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
Data Integration Example Recap
In this Data Integration Example, we made use of all the basic features within DataForge. As a recap, we covered each of the following steps to build an end-to-end integration, pulling data from Da...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
(Databricks only) Recommended Compute Configurations during Development
For environments that are undergoing daily development, it may be beneficial to set up your compute configurations to keep fully-warm compute to reduce startup times. By adjusting the compute idle...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
DataForge Cloud 8.1 Version Features Blog
DataForge Cloud version 8.1 is here, providing streaming support, sub-sources for complex data, and an improved lineage user experience! Table of contents Stream processing Sub-source rules for co...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
Sub-Sources
OverviewThe sub-source feature in DataForge enables developers to easily work with and transform complex nested arrays (Array of Struct). Outside of DataForge, these complex nested arrays are diffi...
- Updated
- 1 follower
- 0 comments
- 0 votes
-
DataForge Cloud 8.0 Version Features Blog
The DataForge Cloud 8.0 release is here, providing support for complex data types, Kafka integrations, and more! Table of Contents Handle Complex Data Types with ease Extended Schema Evolution Int...
- Updated
- 1 follower
- 0 comments
- 0 votes