Issue:
While running the dataflow in the DataOps Suite tool user getting the error - “No space left on device”.

Error from the results page:
{"error" : "Job aborted due to stage failure: Task 92 in stage 251.0 failed 1 times, most recent failure: Lost task 92.0 in stage 251.0 (TID 6648) (dataopsprod.ehealthinsurance.com executor driver): java.io.FileNotFoundException: /opt/datagaps/DataOpsEngine/spark/tmp/blockmgr-674539ed-3ba6-4285-8a5c-f62a111ab64f/22/temp_shuffle_387e2bb6-4080-4c3e-81be-e92f15f7e8a6 (No space left on device)
    at java.io.FileOutputStream.open0(Native Method)
    at java.io.FileOutputStream.open(FileOutputStream.java:270)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:213)



Solution:

This error is occurred because no enough space was available. To overcome this issue user need to clear the space by following the below steps.

1. Stop the Engine service.
2. Delete the tmp directory "/opt/datagaps/DataOpsEngine/spark/tmp". Once deleted, Please create the tmp directory again in the same location.

3. Start the engine service again.