3.5.5
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-demand-service
application UI
Details for Stage 253 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
31 ms
Locality Level Summary:
Process local: 50
Input Size / Records:
3.4 KiB / 7
Associated Job Ids:
177
DAG Visualization
digraph G { subgraph clusterstage_253 { label="Stage 253"; 457 [labelType="html" label="SQLExecutionRDD [457] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; 461 [labelType="html" label="SQLExecutionRDD [461] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; subgraph cluster1343 { label="Exchange"; 452 [labelType="html" label="ShuffledRowRDD [452] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1338 { label="WholeStageCodegen (2)"; 453 [labelType="html" label="MapPartitionsRDD [453] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1337 { label="DeserializeToObject"; 454 [labelType="html" label="MapPartitionsRDD [454] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1336 { label="MapPartitions"; 455 [labelType="html" label="MapPartitionsRDD [455] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1333 { label="WholeStageCodegen (3)"; 456 [labelType="html" label="MapPartitionsRDD [456] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1344 { label="map"; 458 [labelType="html" label="Delta Table State #9 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/demand-channel/_delta_log [458] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1346 { label="WholeStageCodegen (1)"; 459 [labelType="html" label="MapPartitionsRDD [459] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1345 { label="Project"; 460 [labelType="html" label="MapPartitionsRDD [460] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1353 { label="map"; 462 [labelType="html" label="Delta Table State with Stats #9 - hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/demand-channel/_delta_log [462] [Cached] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1968 { label="WholeStageCodegen (1)"; 655 [labelType="html" label="MapPartitionsRDD [655] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } subgraph cluster1972 { label="mapPartitionsInternal"; 656 [labelType="html" label="MapPartitionsRDD [656] [Unordered]<br>$anonfun$recordDeltaOperationInternal$1 at DatabricksLogging.scala:128"]; } } 452->453; 453->454; 454->455; 455->456; 456->457; 457->458; 458->459; 459->460; 460->461; 461->462; 462->655; 655->656; }
451,452
458
462
Event Timeline
Enable zooming
Tasks: 50. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time