Support Questions

Find answers, ask questions, and share your expertise

Scala: read path from dataframe column and merge result


I have a dataframe with an id field and a path, looks like this:

Снимок экрана 2022-11-11 в 06.17.58.png

I need to read the files (csv) and match them with the id. I expect it should work out:

Снимок экрана 2022-11-11 в 06.30.18.png


while I can't even figure out how to read files from the path specified in the dataframe, all my knowledge leads to getting a list of paths from the dataframe and reading each one