Skip to content

[QA] files uploaded via s3cmd with a prefix are not seen by occ file:scan #971

@jnweiger

Description

@jnweiger

Seen while testing files_external_s3-2.0.0-rc.1 with owncloud core 10.11.0-alpha.2

  • Configure an external storage using a scality s3 server
    image

  • Check number of objects with occ file:scan --all
    +---------+-------+--------------+------------------+
    | Folders | Files | Elapsed time | Items per second |
    +---------+-------+--------------+------------------+
    | 24      | 31    | 00:00:01     | 56               |
    +---------+-------+--------------+------------------+
    
    
  • Add a file to the bucket (without path prefix) s3cmd put /var/www/owncloud/data/owncloud.log s3://oc-external/
  • Check number of objects with occ file:scan --all -- it is one more. OK
    +---------+-------+--------------+------------------+
    | Folders | Files | Elapsed time | Items per second |
    +---------+-------+--------------+------------------+
    | 24      | 32    | 00:00:01     | 54               |
    +---------+-------+--------------+------------------+
    
    
  • Add a file to the bucket (with prefix) s3cmd put /var/www/owncloud/data/owncloud.log s3://oc-external/logs/oc.log
  • Check number of objects with occ file:scan --all -- nothing changes. BAD
    +---------+-------+--------------+------------------+
    | Folders | Files | Elapsed time | Items per second |
    +---------+-------+--------------+------------------+
    | 24      | 32    | 00:00:01     | 49               |
    +---------+-------+--------------+------------------+
    
    
  • Visit the external storage via owncloud. The /oc-bucket/logs folder does not appear. BAD

Workaround:

  • Create the /oc-bucket/logs folder via owncloud.
    image

  • Examine contents of the logs folder. The oc.log file is there.
    image

  • Now also occ file:scan reports the new folder and the new file.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions