Wed, 12 October 2011
Devops tools fools and other smart things
-Craftsman vs artist... -It’s not about the tools it’s about the craftsmanship -Tools as objects to think with -Create places and spaces to create boundary objects -Boundary objects give way to technical debt... -Craftsman swaps (Week) Craftsman journey (week)... -Automation free up time to do more design...
-----------------------------------------------------------------------------
Evolving Continuous Deliver - Chris Read (GotoCon 2011)
What we were told... (the ROE) -Single Source Repository -Automate Build and Testing -Publish Latest Distributable -Every Commit Builds -Test in Production Like Environment -Keep Builds Fast -Use Information Radiators -Automate Deployment -Build Binary Once -Promote Binary Through Stages
Initial State -Releasing daily from developer -workstations to production -No Continuous Integration! -Using Fig for dependency management
Stage 1 -Standardize and Re-factor the build scripts - Add Continuous Integration server -Set up an Information Radiator
Later Stages.... -Sideline the Continuous Integration loop -Bake the Continuous Integration safeties into the deployment scripts -Automate server builds -Start to scale services out -Fracture services out into stacks -Stage the binaries -Fast rollbacks
-1 Week to 30 minutes... -Requires architectural vision & discipline -Short code half life & unix philosophy -Minimize risk by co-locating customers -Prodigious monitoring
-----------------------------------------------------------------------------
Information radiator http://alistair.cockburn.us/Information+radiator
An Information radiator is a display posted in a place where people can see it as they work or walk by. It shows readers information they care about without having to ask anyone a question. This means more communication with fewer interruptions.
-----------------------------------------------------------------------------
Launch EC2 Spot Instances in a Virtual Private Cloud
We've combined two popular AWS features, Amazon EC2 Spot Instances and the Amazon Virtual Private Cloud (Amazon VPC). You can now create a private, isolated section of the AWS cloud and make requests for Spot Instances to be launched within it.
Launching Spot Instances into Amazon VPC requires special capacity behind the scenes, which means that the Spot Price for Spot Instances in an Amazon VPC will float independently from those launched outside of Amazon VPC.
-----------------------------------------------------------------------------
IBM to Acquire System Software Company Platform Computing to Extend Reach of Technical Computing
Clusters, Grids and Clouds...
IBM is a weird bird.. They buy overpriced companies just before they are about to go obsolete. Cognos... Big Data? Platform Computing... Cycle Computing.. Openstack..
Either they are stupid or they run the numbers and release there is money to make in the interim..
IBM's recent acquisitions (last 3 yrs) seem to be untimely unlike their prior 10 years...
-----------------------------------------------------------------------------
http://wiki.opscode.com/display/chef/Opscode+Community+Summit
Nov 29 & 30 2011 Seattle
-What is the roadmap for Opscode & Chef?- -What must we do to expand & thrive?- -What best practices have emerged & how should we share them? -How will our community grow while serving experts and welcoming newcomers? -What should the Opscode Conference & other events in 2012 cover?
-----------------------------------------------------------------------------
Russian Nginx raises $3 million from international investors
Russian company Nginx raised $3 million from German BV Capital, Russian Runa Capital andMSD Capital, Michael Dell‘s venture fund, as reported by RBK Daily. |
Tue, 11 October 2011
Untethered, CFEngine hitches a lift on Android http://www.cfengine.com/blog/cfengine-android
The latest chapter of this story is the touching of two branches of this freedom: the internet information ecology and mobile communications. We are talking, of course, about smartphones and their heavier brethren `pads'. What about configuration management of these devices?
-encryption of memory, -pin code or password protection, -software updates, -application version control, are pressing.
Open Source android does not allow the notion of a privileged monitor on which most management frameworks are built.
CFEngine has an andriod prototype..
Android 2.2 introduces support for enterprise applications byhttp://developer.android.com/guide/topics/admin/device-admin.html
-----------------------------------------------------------------------------
The next five years of cloud and client computing, Mark Shuttleworth, Ubuntu - YouTube
Mark Shuttleworth.... Get past the initial introductions in French.. then initial talk about tablets and smart devices... About 1/2 of the way in the data center...
Lingua Franca- http for api's, Iaas for cloud, openstack as the apache of cloud.
Leadership is key factor from spinning out of control..
Virt platofrms... virt ... kvm .... standard virt platform... lxc .. containers ... (trade isolation fro performance) trusted workloads choice lxc...
Ubuntu ... Openstack work with LXC...
Cloudfoundry.... savy move... generic harness for PaaS... bridging layer... Openstack.. Cloudfoundry ...
Efficiency... ARM... ARM in the datacenter. Ubuntu 11.10 first widely release Ubuntu that will treat ARM as a first class power density, performance density..
Human scalability... Ops became much more of an eng/dev opposed to maint.. server rations up 10 to 20x
1 to 10k or higher in the future...
How to scale in non flat orgs (legacy IT) .. Chef and Puppet... Spray it...
Devops... Defining the language that we speak.. turnover...
New service deployment... Config doesn't address. Which 10k machines need that change..what order
Key driver .. scaling CM.. "Service Orchestration" blurs the line between IaaS and PaaS.. Juju.. Ubuntu means Humans. Juju means super natural humans..
pkg metaphor... for services... like a package knows where all the pieces for a software pkgs need to go juju knows where all the
In the next five years everything will change except the beauty of paris...
-----------------------------------------------------------------------------
Multi-Platform Messaging with RabbitMQ http://www.infoq.com/presentations/Multi-Platform-Messaging-with-RabbitMQ Rob Harrop
5 different Languages and two different protocols...
Java2days 2009 - Java Concurrency in 5 Languages ( Scala, Java, Erlang, Clojure, Groovy).
Rob Harrop demoes how to use RabbitMQ from a variety of languages (Java, Python, Ruby and Erlang) and different environments using AMQP and STOMP to achieve for multi-platform communication.
4 Languages... Java, Python, Ruby, Javascript, Erlang, and Telnet....
RabbitMQ is naitivly multiprotocal . stomp, amqp. ....
Great overview of RabbitMQ...
Most important thing in RabbotMQ is it is not JMS. Forget what you know about JMS and re-discover...
Examples Java Consumer to Pyhton publisher... w/AMQP Java Consumer to Erlang publisher... w/AMQP
Examples STOMP Adapter (ActiveMQ) Ruby Consumner Telnet publisher
Then gets xrazy... Multiple languages ruby, telnet, NodeJS...
Demo
NodeJS and SocketIO to link RabbitMQ and Node together...
https://github.com/robharrop/presentations/tree/master/2011/whats-next-paris
Recommend book for Javascript
JavaScript: The Good Parts |
Mon, 10 October 2011
Got open source cloud storage? Red Hat buys Gluster
-Red Hat’s $136m acquisition of open source storage vendor Gluster marks Red Hat’s biggest buy since JBoss -GWOS and Zenoss rumors... -Given its recent quarterly earnings report and topping the $1 billion annual revenue mark, Red Hat seems again to be bucking the bad economy.
-----------------------------------------------------------
1 Million User Party: Mon Oct 17 in SF
Openbar till 11pm... Wish I could be there....
-----------------------------------------------------------
2012 Fukuoka Ruby Award Competition & FOG
Wesley Beary @geemus
https://gist.github.com/1248281
http://www.myfukuoka.com/events/2012-fukuoka-ruby-award-competition
Grand Prize (1 Million Yen) Outstanding Performance Awards (100,000 Yen)
--------------------------------------------------------------
Ubuntu and the Cloud... http://cloud.ubuntu.com/2011/10/ubuntu-cloud-live/
Ubuntu Orchestra
JUJU using LXC on a Laptop .. can run it in virtulization.. openstack or EC2....
In the front of the stage, we have a portable rack of servers (a 40-core Intel Emerald Ridge, a 24-core HP Proliant, a 16-core Dell Precision, with a System76 local Ubuntu mirror, and Cisco networking hardware). We've used Ubuntu Orchestra to remotely install the systems, and we've deployed OpenStack to the rack. Once OpenStack is running, Clint has a series of Hadoop jobs that he spins up and runs against dozens of instances on the local Nova compute node. And for the real whiz-bang, Clint uses gource for dynamic visualization of the Hadoop cluster, the various nodes, and their relationships. It is absolutely stunning to behold!
To get started download the image from: http://people.canonical.com/~akarama/binary.img
Ubuntu 11.10 Oct 13...
-------------------------------------------------------------- Open Stack Summit Summary...
Matt Ray... Bell of the ball.... I worked my ass off to hire him at Opscode... Ironic story...
User adoption is really taking off, and we’ll be hearing from MercardoLibre, CERN, Sony Computer Entertainment America, Fidelity, Disney, and NeCTAR Summit...
Rackspace’s intention to form an OpenStack Foundation in 2012 http://www.openstack.org/blog/2011/10/openstack-foundation/
-organizations backing OpenStack is now well over 110, including industry giants such as Cisco, HP, and Dell. -Clouscaling, Piston and Nebula -Techstars recently announced an incubator program for Cloud start ups -User adoption is really taking off, and we’ll be hearing from MercardoLibre, CERN, Sony Computer Entertainment America, Fidelity, Disney, and NeCTAR -HP using Openstack huge contributor... -They also plan on posting their own Chef cookbooks and apparently they have their own crowbar like implementation. -Dell w/Crowbar was giving demos...
Complete list for blueprints...
https://blueprints.launchpad.net/openstack
Git support for gt/jenkins....
--------------------------------------------------------------
Windows Registry-based Idempotence Check with Chef http://delivermind.blogspot.com/2011/10/windows-msi-idempotence-with-chef.html
registry_helper.rb is used to check for an already installed product... --------------------------------------------------------------
Puppet vs. Chef, Fight! http://devopsanywhere.blogspot.com/2011/10/puppet-vs-chef-fight.html
If you aren't yet using Puppet or Chef for managing your *nix infrastructure, you should seriously consider it.
The Criteria
-Community Strength -Leadership -Corporate Adoption -Technical Merits -Hands-on Experience
Community Size
Number of people on IRC on Sunday Oct 9th, 2011 10 AM GMT #puppet 541 users #chef 233 users
Mailing Lists puppet-users 3363 members, 5961 topics chef: 600 members, # of topics unknown
Quality of Cookbook Sites
http://community.opscode.com/cookbooks
Github Repositories: puppet: 1622 repositories chef: 1299 repositories
Pro Puppet, by Puppet Labs engineer James Turnbull, is an awesome introduction to Puppet. I found it immensely helpful. There is a 50-page O'Reilly publication on Chef, Test-Driven Infrastructure with Chef, but it cannot match the breadth of Pro Puppet...
Leadership
Luke... I spoke to Luke .. he told me he actually put a lot of efford into becoming a CEO... Scott Johnston new VP or Product and Marketing Director, Product Management, New Business Ventures atCisco Systems Director, Customer Operations at Loudcloud Director, Product Management at Geocast Network Systems Director, Product Management, Web/Application Servers atNetscape Partner at Alloy Ventures
Opscode now has Mitch Hill: Chief Executive Officer 8 guys to almost 1bill exit...
Opscode has battery and Puppet kliener perkins |
Thu, 6 October 2011
New - Amazon S3 Server Side Encryption for Data at Rest http://aws.typepad.com/aws/2011/10/new-amazon-s3-server-side-encryption.html
Amazon S3 Server Side Encryption handles all encryption, decryption, and key management in a totally transparent fashion. When you PUT an object and request encryption (in an HTTP header supplied as part of the PUT), we generate a unique key, encrypt your data with the key, and then encrypt the key with a master key. For added protection, keys are stored in hosts that are separate and distinct from those used to store your data. ---------------------------------------------------------------
chef.vim is plugin which make it easy for https://github.com/t9md/vim-chef/
-jump between attributes and recipes -jump between LWRP's providers and resources -open recipes by extract filename from include_recipe -open templates and files -jump to attributes -jump to definition -jump to LWRP
--------------------------------------------------------------
https://groups.google.com/group/ruby-fog/browse_thread/thread/ad46c2738b434967?pli=1
Stats! { 'collaborators' => 16, 'downloads' => 245,745, 'forks' => 260, 'open_issues' => 13, 'watchers' => 1521 }
-MVP! Patrick Debois [Libvirt] -[aws|elasticache]
--------------------------------------------------------------
How Ruby is beating Python in the battle for the Soul of System Administration http://devopsanywhere.blogspot.com/2011/09/how-ruby-is-beating-python-in-battle.html
- In many ways it is the love child of perl and smalltalk.
Comments
-For CM, you missed bcfg2 which is written in Python.
---------------------------------------------------------------
COUCHDB SERVICE FOR CLOUDFOUNDRY http://blog.zephirworks.com/couchdb-service-for-cloudfoundry
---------------------------------------------------------------
Using Chef to Customize Multi-Node Cloud Foundry Deployments
http://blog.cloudfoundry.com/post/10816758982/using-chef-to-customize-multi-node-cloud-foundry VCAP... Chef-Solo Install
---------------------------------------------------------------
LEAN STARTUP, by Eric Ries http://www.nytimes.com/best-sellers-books/2011-10-09/hardcover-advice/list.html
---------------------------------------------------------------
Operations is a Strategic Weapon (PuppetConf) http://www.slideshare.net/dev2ops/operations-is-a-strategic-weapon-puppetconf
---------------------------------------------------------------
OpenStack Diablo is a Quantum Leap for Open Source Cloud
-Web-based dashboard for managing and provisioning OpenStack-based clouds.
-Keystone...
---------------------------------------------------------------
http://www.infoq.com/presentations/HBase-at-Facebook
-25 TB per month of msgs and Chat data... -Previously stored in Mysql -Looking for a system with high wrote throughput with good reads... -Ironic because they actually invented Cassandra.. -Need to scale gracefully...
---------------------------------------------------------------
Riak 1.0 Is Officially Released! http://blog.basho.com/2011/09/30/Riak-1-dot-0-is-Official/
---------------------------------------------------------------
https://github.com/HoneyApps/chef-mod_security
This package is to make deployment and testing of mod_security easier with chef. Right now it centers entirely around the OWASP Core Rule Sets of mod_security rules. In future, it will allow you to manage/deploy custom rule/rulesets of your own.
---------------------------------------------------------------
DevOps is DOA http://www.zdnet.com/news/devops-is-doa/6308483
Engine Yard co-founder Tom Mornini weighs in on whether #PaaS is the #DevOps killer. Hmmm. zd.net/mRqy5I
Also CA..
---------------------------------------------------------------
Gartner Says Worldwide Platform as a Service Revenue is on Pace to Reach $707.4 Million in 2011 http://www.gartner.com/it/page.jsp?id=1815214
Worldwide platform as a service (PaaS) revenue is on pace to reach $707.4 million in 2011, up from $512.4 million in 2010, according to Gartner, Inc. The market will experience consistent growth with worldwide PaaS revenue totaling $1.8 billion in 2015. |
Tue, 4 October 2011
John and Damon venture to the Pacific Northwest for PuppetConf in Portland, OR. Joining them live onstage is a panel of Puppet Labs senior executives: Luke Kanies (CEO), Scott Johnston (Marketing), James Turnbull (Technical Operations), Teyo Tyree (Business Development). |