daft.DataFrame.from_glob_path#

classmethod DataFrame.from_glob_path(path: str) daft.dataframe.dataframe.DataFrame[source]#

Creates a DataFrame of file paths and other metadata from a glob path

This method supports wildcards:

  1. “*” matches any number of any characters including none

  2. “?” matches any single character

  3. “[…]” matches any single character in the brackets

  4. “**” recursively matches any number of layers of directories

The returned DataFrame will have the following columns:

  1. path: the path to the file/directory

  2. size: size of the object in bytes

  3. type: either “file” or “directory”

Example

>>> df = DataFrame.from_glob_path("/path/to/files/*.jpeg")
>>> df = DataFrame.from_glob_path("/path/to/files/**/*.jpeg")
>>> df = DataFrame.from_glob_path("/path/to/files/**/image-?.jpeg")
Parameters

path (str) – path to files on disk (allows wildcards)

Returns

DataFrame containing the path to each file as a row, along with other metadata

parsed from the provided filesystem

Return type

DataFrame