The seeds for Crowbar 2.0 have been in the 1.x code base for a while and were recently accelerated by SuSE. With the Dell | Cloudera 4 Hadoop and Essex OpenStack-powered releases behind us, we will now be totally focused bringing these seeds to fruition in the next two months.
Getting the core Crowbar 2.0 changes working is not a major refactoring effort in calendar time; however, it will impact current Crowbar developers by changing improving the programming APIs. The Dell Crowbar team decided to treat this as a focused refactoring effort because several important changes are tightly coupled. We cannot solve them independently without causing a larger disruption.
All of the Crowbar 2.0 changes address issues and concerns raised in the community and are needed to support expanding of our OpenStack and Hadoop application deployments.
Our technical objective for Crowbar 2.0 is to simplify and streamline development efforts as the development and user community grows. We are seeking to:
simplify our use of Chef and eliminate Crowbar requirements in our Opscode Chef recipes.
- reduce the initial effort required to leverage Crowbar
- opens Crowbar to a broader audience (see Upstreaming)
provide heterogeneous / multiple operating system deployments. This enables:
- multiple versions of the same OS running for upgrades
- different operating systems operating simultaneously (and deal with heterogeneous packaging issues)
- accommodation of no-agent systems like locked systems (e.g.: virtualization hosts) and switches (aka external entities)
- UEFI booting in Sledgehammer
strengthen networking abstractions
- allow networking configurations to be created dynamically (so that users are not locked into choices made before Crowbar deployment)
- better manage connected operations
- enable pull-from-source deployments that are ahead of (or forked from) available packages.
improvements in Crowbar’s core database and state machine to enable
- larger scale concerns
- controlled production migrations and upgrades
other important items
- make documentation more coupled to current features and easier to maintain
- upgrade to Rails 3 to simplify code base, security and performance
- deepen automated test coverage and capabilities
Beyond these great technical targets, we want Crowbar 2.0 is to address barriers to adoption that have been raised by our community, customers and partners. We have been tracking concerns about the learning curve for adding barclamps, complexity of networking configuration and packaging into a single ISO.
We will kick off to community part of this effort with an online review on 7/16 (details).
PS: why a refactoring?
My team at Dell does not take on any refactoring changes lightly because they are disruptive to our community; however, a convergence of requirements has made it necessary to update several core components simultaneously. Specifically, we found that desired changes in networking, operating systems, packaging, configuration management, scale and hardware support all required interlocked changes. We have been bringing many of these changes into the code base in preparation and have reached a point where the next steps require changing Crowbar 1.0 semantics.
We are first and foremost an incremental architecture & lean development team – Crowbar 2.0 will have the smallest footprint needed to begin the transformations that are currently blocking us. There is significant room during and after the refactor for the community to shape Crowbar.