Architecture and Design

The following sections give an overview of the architecture and design considerations behind DALiuGE.

• Concepts and Background
  • Dataflow
  • Graph
  • Data-activated
• Drops
  • Lifecycle
  • Events
  • Relationships
  • Input/Output
  • Drop Channels
  • Drop Component Interface
• Graphs
  • Logical Graph
    • Component properties
    • Complex components (Constructs)
    • Repositories
    • Usage of Logical Graph Templates and Logical Graphs
  • Translation
    • Basic steps
    • Scheduling Algorithms
  • Physical Graph
  • Execution
  • Parallelism
  • Shared Memory
  • Environment Variables
• Drop Managers
  • Sessions
  • Node Drop Manager
  • Data Island Drop Manager
  • Master Drop Manager
  • Interface
  • Clients
• Data Lifecycle Manager
• Scientific Reproducibility
  • R-Mode Standards
    • Rerunning
    • Repeating
    • Recomputing
    • Reproducing
    • Replicating - Scientifically
    • Replicating - Computationally
    • Replicating - Totally
  • Technical approach
    • Merkle Trees
    • BlockDAGs
    • Runtime Provenance
    • Translate-time Provenance
    • Signature Building
  • Hello World Example
    • Hello World Bash
    • Hello World Python
    • Hello Everybody Python
    • Signature Comparisons
  • Graph Certification
    • Certifying a Graph
    • Tips on Making Graphs Robust
  • Creating New Drop Types
• References