Scala: for loop: iterating over a a directory stream

Question

Update: I have written the following updated code after inputs from Scala experts here. Here below is the updated code. The code compiles, but on "run" throws an IllegalStateException: I posted the error stacktrace after the code listing:

import java.io.IOException
import java.nio.file.FileSystems
import java.nio.file.FileVisitOption
import java.nio.file.FileVisitResult
import java.nio.file.FileVisitor
import java.nio.file.Files
import java.nio.file.Path
import java.nio.file.Paths
import java.nio.file.attribute.BasicFileAttributes
import java.util.EnumSet
import java.nio.file.{DirectoryStream,DirectoryIteratorException}
 import scala.collection.JavaConversions._

class TestFVis(val searchPath: Path) extends FileVisitor[Path] {

    //Here I provide implementations for postVisitDirectory,  
    //preVisitDirectory, visitFile, and visitFileFailed

}



object Main {

  def main(args: Array[String]) {
    val searchFileOrFolder: Path = Paths.get("C://my_dir")
    println("The Path object is: " + searchFileOrFolder)
    var testFileVisitorTop = new TestFVis(searchFileOrFolder)
    println("Our top level FileVisitor is: " + testFileVisitorTop)

     val opts = EnumSet.of(FileVisitOption.FOLLOW_LINKS)
    val rootDirsIterable: Iterable[Path] = FileSystems.getDefault.getRootDirectories //returns the default filesystem
    // and then returns an Iterable[Path]  to iterate over the paths of the root directories

      var dirStream:Option[DirectoryStream[Path]] = None

      for(rootDir <- rootDirsIterable) {
        println("in the Outer For")
        dirStream= Some(Files.newDirectoryStream(searchFileOrFolder))
        def dstream = dirStream.get
        val streamIter = dstream.iterator().filter((path) => {
                     Files.isRegularFile(path)
                   })

        for( dirStreamUnwrapped <- dirStream;(filePath:Path) <- dirStreamUnwrapped) {
        //for( (filePath: DirectoryStream[Path]) <- dirStream) {
            val tempPath = Files.walkFileTree(filePath, testFileVisitorTop) 
            //val tempPath = Files.walkFileTree(fileOrDir,opts,Integer.MAX_VALUE,testFileVisitorTop)
            println("current path is: " + tempPath)
            if (!testFileVisitorTop.found) {
              println("The file or folder " + searchFileOrFolder+ " was not found!")
            }
        }


      }

  }
}

---

However for historical context here is the compile error I got at first:

[error]  found   : java.nio.file.Path => Unit
[error]  required: java.nio.file.DirectoryStream[java.nio.file.Path] => ?
[error]                 for((filePath:Path) <- dirStream) {

-- After changing the code: The code compiles with no errors, but I get an IllegalStateException on sbt 'run'\

> run
ur top level FileVisitor is C:\my_dir
Our top level FileVisitor is: com.me.ds.TestFileVisitor
@5564baf6
in the Outer For
[error] (run-main-0) java.lang.IllegalStateException: Iterator already obtained
java.lang.IllegalStateException: Iterator already obtained
        at sun.nio.fs.WindowsDirectoryStream.iterator(WindowsDirectoryStream.jav
a:117)
        at scala.collection.convert.Wrappers$JIterableWrapper.iterator(Wrappers.
scala:54)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.s
cala:777)
        at com.me.ds.Main$$anonfun$main$1$$anonfun$appl
y$1.apply(SampleFileVis.scala:76)
        at com.me.ds.Main$$anonfun$main$1$$anonfun$appl
y$1.apply(AFileVisitor.scala:76)
        at scala.Option.foreach(Option.scala:256)
        at **com.me.ds.Main$$anonfun$main$1.apply(SampleFileVisitor.scala:76)**
        at com.me.ds.Main$$anonfun$main$1.apply(AFileVi
sitor.scala:68)
        at scala.collection.Iterator$class.foreach(Iterator.scala:743)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1195)
        at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
        at com.me.ds.Main$.main(SampleFileVis.scala:68)
        at com.me.ds.Main.main(SampleFileVis.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
sorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:483)
[trace] Stack trace suppressed: run last compile:run for the full output.
java.lang.RuntimeException: Nonzero exit code: 1
        at scala.sys.package$.error(package.scala:27)
[trace] Stack trace suppressed: run last compile:run for the full output.
[error] (compile:run) Nonzero exit code: 1
[error] Total time: 0 s, completed Mar 24, 2015 7:32:38 AM
>

=------------- I am going out and investigating the error on my own also. If someone can point me in the right direction here that would make my code compile and run, I would have accomplished my goal here.

thanks

Answer 1

1. object needs to be lowercase.

2. dirStream needs to be preceded by val.

3. you have too many } at the end.

4. you have new TestFileVisitor but you meant new TestFVis.

5. dirStream has type: Some[DirectoryStream[Path]], which means that you need (filePath: DirectoryStream[Path]) <- dirStream

Answer 2

All you are doing with the first for is unwrapping the Option, which cannot be cast to a Path. You just need to take your unwrapped object and use it in the next part:

for(dirStreamUnwrapped <- dirStream;
    (filePath:Path) <- dirStreamUnwrapped) {
  val tempPath = Files.walkFileTree(filePath, testFVis) 
}