Magento – Run Import Product from CLI

Ashley Schroder has written a Google Docs/Drive adapter for the ImportExport module. It's not dataflow and it's fast!

If you really want to do additional processing before doing an import, you may consider using an array-based ImportExport extension such as ApiImport. An added benefit is that it takes care of a bunch of stuff for you (such as indexing). In that case you would have to write the glue between fetching google docs CVS, converting it to an appropriate format, and doing the import.

If only it was all that simple companies would not spend $10s to $100s thousands on Supplier Onboarding tools and ETL/ESB connectors. There is no business information, Magento CE or EE, website or global pricing, percentage of records changing per day, whether you have a separate admin/batch server, size of company either orders per day - visitors per day - revenue per year. All these affect the choice of the solution.

Now, if you are not interested in the business side and just want a technical solution you have Magmi, import scripts via API (with or without indexing switched on), or ETL tools (SaaS or in-house). The devil though is in the detail. An example, if you use API without index onsave you need to reindex, if you have too many stores or too many products on a high volume site, you have frontend issues. If you do not have a cluster this overloads the servers slowing performance, and if you have website pricing you need to perform multiple updates. For all intents and purposes Magmi is the API without index on save, just a lot faster. So if you have a high-volume site you use either EE or CE with index on save.

We have worked with sites with 100s stores and 100s thousands of products with website-pricing and automated data loading (the most complex of complex until the soft limit of Magento was hit, pushed passed it, and hit a hard limit) all the way down to the simplest store. If you are a single store (or in your case double) with single currency with 5,000 products then the API load script, Magmi and reindex, or CSV uploads will work just fine, any more and it all starts to become very complex the more you add, hence why we are under nda for the solutions as the high-end consultants who developed them are only a handful who have any idea how to bring all the pieces together (hosting, clusters, indexing, loading, delta records, data cleaning, data mapping).

Just stick with the script, you can enhance it with Magmi calls to their API so you get the best of both worlds, one of the solutions from the consultants did this, if it is working why change it.