3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-demand-service
application UI
Details for Stage 158 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Process local: 9
Input Size / Records:
33.0 KiB / 43
Shuffle Write Size / Records:
18.3 KiB / 43
Associated Job Ids:
114
DAG Visualization
digraph G { subgraph clusterstage_158 { label="Stage 158"; subgraph cluster1248 { label="Scan parquet "; 414 [labelType="html" label="FileScanRDD [414]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 415 [labelType="html" label="MapPartitionsRDD [415]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1244 { label="WholeStageCodegen (1)"; 416 [labelType="html" label="MapPartitionsRDD [416]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1252 { label="Scan json "; 417 [labelType="html" label="FileScanRDD [417]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 418 [labelType="html" label="MapPartitionsRDD [418]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1249 { label="WholeStageCodegen (2)"; 419 [labelType="html" label="MapPartitionsRDD [419]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1243 { label="Union"; 420 [labelType="html" label="UnionRDD [420]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1242 { label="Exchange"; 421 [labelType="html" label="MapPartitionsRDD [421]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 414->415; 415->416; 417->418; 418->419; 416->420; 419->420; 420->421; }
Event Timeline
Enable zooming
Tasks: 9. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time