Improvements

[johnandersen777]

Thread to document any improvements to DFFML anyone can think of, please comment!

[johnandersen777]

Consider moving existing dataflow tutorial content under examples

[johnandersen777]

• Update notifications when new releases are available
• Backups for models
• Backups for caching dataflows when implemented

[johnandersen777]

Source: https://gitter.im/dffml/community?at=622ccf2d99d94f5f0c49c1dd

Anish "tried reinstalling numpy, but it doesn't seem to be working. Not sure if there is any additional setup required for the M1. Any pointers are much appreciated!"

Hashim responded with " I'd advise you to install dffml on rosetta rather than the native environment. I tried that a few months ago and there were a couple of dffml dependencies not yet available for ARM64 architecture. So even if you're able to fix this issue, you'll probably run into more. If you don't know how to set up a rosetta environment or face any other problems, ping here and we'll figure something out."

nepthius: "Just installed and now it works, thanks a bunch!!"

[johnandersen777]

• We need to have a first version of the Automating classification demo without the mysql database or web app, just a CSV file

[johnandersen777]

Need to have Python examples, not CLI

[johnandersen777]

Need to implement dffml.high_level.merge()

[johnandersen777]

Need to have tabs for Python, CLI, HTTP

[johnandersen777]

We should get rid of the github query, just supply a list

[johnandersen777]

• At the repo on github in UI

  • main is the default
  • dev is the development
  • dev is 28 behind and 142 ahead of main
  • PR 152
  • Can't click UI resolve conflicts
    • Github Instructions for CLI resolution
      • git pull origin main
        • Need to checkout this branch first
        • git checkout main
      • git checkout dev
      • git merge main
        • Lots of conflicts
          • Used GitHub Desktop to resolve
            • GitHub Desktop (and Electron App) reads in .git state and understands we need to resolve merge conflicts

            • Seeing TextEditor became Editor. Properties added in main.

            • git status will tell you the proper way to abort what your in
            • (dev) git switch dev-fix-28 (rebase in the missing 28)
            • git rebase main
            • git rebase --show-current-patch
              • This shows you the patch git is attempting to apply
              • THis is the conflict which we are resolving, git is not sure how to apply this patch
              • Search for filename of deleted file
                • Scroll up until you find what commit this file was deleted in
                • The file was deleted recently
                • We know we want the version of the file from main
                • git checkout --theirs path/to/file.py
                  • Updated 1 path form the index
                  • git status
                  • deleted by us: path/to/file.py
                  • git add path/to/file.py
                  • git status
                  • new file: path/to/file.py
                  • git diff
                  • See edits to another file
                  • git rebase --show-current-patch
                  • We see the patch is only trying to make a one line change to the file
                  • git checkout --theirs path/to/oneline.py
                  • vim oneline.py
                  • Reference output of git rebase --show-current-patch
                  • Looks like the output is already included at the same location (looked at sournding variables)
      • git push -u origin main

• Take all of development changes and put in main

$ git checkout --theirs -- .