anti virus - Deleting sentences in database file

08
2014-07
  • Gabriel

    I'm writing a MD5 based antivirus, and my friend send to me a document with thousands of samples and their MD5. All is fine, but I have to delete all sentences what contain "File does not exists:" along with the short numbers between Virus name and the MD5 hash.

    How can I accomplish this?

    Screen of problem:

  • Answers
    Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

    Related Question

    hashing - Can you use OpenSSL to generate an md5 or sha hash on a directory of files?
  • Kieveli

    I'm interested in storing an indicator of file / directory integrity between two archived copies of directories. It's around 1TB of data stored recursively on hard drives. Is there a way using OpenSSL to generate a single hash for all the files that can be used as a comparison between two copies of the data, or at a later point to verify the data has not changed?


  • Related Answers
  • AaronLS

    You could recursively generate all the hashes, concatenate the hashes into a single file, then generate a hash of that file.

  • John T

    You can't do a cumulative hash of them all to make a single hash, but you can compress them first then compute the hash:

    $tar -czpf archive1.tar.gz folder1/
    $tar -czpf archive2.tar.gz folder2/
    $openssl md5 archive1.tar.gz archive2.tar.gz
    


    to recursively hash each file:

    $find . -type f -exec openssl md5 {} +
    
  • Rudedog

    Doing a md5 sum on the tar would never work unless all of the metadata (creation date, etc.) was identical as well, because tar stores that as part of its archive.

    I would probably do an md5 sum of the contents of all of the files:

    find folder1 -type f | sort | tr '\n' '\0' | xargs -0 cat | openssl md5
    find folder2 -type f | sort | tr '\n' '\0' | xargs -0 cat | openssl md5