Tag Archives: performance

CMG Pune Meet: Scalable Data Streaming; Mobile Tracking & Analytics; Benchmarking OpenStack – 12 Sept

Events, Featured, , , , , ,

CMG India, a professionals’ forum for measurement and quantitative analysis in IT enterprises, invites performance engineering and capacity management professionals to their fourth half-day event in Pune, on September 12th, 2014, 2:30pm, BMC Software (near Pune Golf Course). This event is free for anyone to attend. See here for details on how to register.

Agenda

Agenda

  • 2:15pm: Event kick off
  • 2:30pm: Reliable and Scalable Data Streaming in Multi-Hop Architecture, Sudhir Sangra, BMC
  • 3:15pm: Optimization for Large Scale Wi-Fi Mobile Device Tracking & Analytics System, Santosh Kangane, Persistent
  • 4:00pm: Break
  • 4:15pm: Rally – Performance benchmarking of openstack – private cloud, Deepak Mane, TCS
  • 5:00pm: Windup

Reliable and Scalable Data Streaming in Multi-Hop Architecture – Sudhir Sangra

The changes in technologies, customer requirements, and visualization and consumption of data demands has led multiple point products to integrate and evolve into a solution. The value of the solution is in the seamless flow of information through multiple product layers and consuming this information in real time. Many times, if the “time to consume” the data to build information is not within the agreed service levels, the data loses its value. Thus, timeliness and reliability are the two most important aspects of multi-layered application integration.

In the IT Management domain, the data collection and the system analytics engines need to go hand-in-hand. The data collectors should feed the analytics serves in real-time, to enable it to build intelligent analysis and to do various sorts of data modelling to help IT Managers have the holistic view of the underlying system resources and let them perform a root cause analysis of any problem proactively. The more granular, and consistent data, the more accurate will be the analytics and capacity estimates.

Sudhir Sangra is the Product Development Architect at BMC, leading data centre performance and availability solution suite.  One of the focus area in recent time is fault tolerant, Load balance, real time data management.

Optimization for Large Scale Wi-Fi Mobile Device Tracking & Analytics System – Santosh Kangane

Mobile Device Tracking System handles the movement of 70K+ mobile devices in WiFI network and present valuable insides like, Most famous paths, crowded places on flowers, patterns of device movement in Wi-Fi network, device count on different flowers and Zones.

The case study present optimization around handling heavy write operation and performing analytics on Oracle database. It demonstrate the effective use of Oracle performance monitoring tools like OEM, AWR & ADDM report. How to draw conclusions from reports and co-relate that with Oracle internal functioning to gain maximum benefit.

Rally – Performance benchmarking of openstack – private cloud – Deepak Mane

OpenStack is open-source software which is used for building public or private clouds. Competitors include VMware, vCloud and Amazon Web Services (News – Alert), so steps need to be taken to make OpenStack as popular as possible in the competitive marketplace.

OpenStack has become increasingly important to enterprises of all sizes as its reach extends beyond Web 2.0/SaaS companies, such as Workday, Webex and PayPal. OpenStack is now a major element of both enterprise cloud computing and broader cloud initiatives.

Customers also need to know how well OpenStack performs, but OpenStack is complex with many subsystems and components, which makes it hard for customers or potential customers to predict how “different implementation decisions and changes proposed to OpenStack affect the whole system’s behavior and performance,” according to a statement from Mirantis. On top of this, there are many alternative cloud configurations where OpenStack can be installed and used. Benchmarking becomes very difficult because it’s hard to get results from just parts of OpenStack. What was needed is a way to find benchmarking on the entire OpenStack system, with a predefined cloud configuration, the company explained. The benchmarking tool would also need to come up with complex and reproducible scenarios on actual OpenStack deployments.

In other words, customers basically need to monitor how well of a job OpenStack is doing. So IBM, SoftLayer (News – Alert) (part of IBM) and Mirantis have developed Rally. It’s a benchmarking tool that reports on OpenStack performance.

In this session, we describe the details behind the process, talk about the Rally – Performance benchmarking tool , performance assessment strategies we used. We’ll also share our findings on key scalability and performance bottlenecks, validations approaches, and suggest solutions.Performance benchmarking of Openstack component – nova.

About CMG Pune

Computer Measurement Group is a not-for-profit, worldwide organisation of IT professionals committed to sharing information and best practices focused on ensuring the efficiency and scalability of IT service delivery to the enterprise through measurement, quantitative analysis, and forecasting. CMG Inc, which is headquartered in New Jersey, USA was setup in 1975 and it now has more than 25 US and International Chapters.

CMG India has been recently setup with the objective of networking performance engineering and capacity management professionals across India. Large IT systems across India need to process millions of transactions per day and CMG India will allow for the experts to share their experiences and learn from one another. The facilitation will be done through regional events across major cities, an annual conference, and posting technical articles on this site.

See the CMG India website for more information.

Fees and Registration

Seating capacity is limited. Event participation is only for CMG India members – but you can sign up for a free membership here: http://www.cmgindia.org/punevent-registration/. Members can register for this event here: http://www.cmgindia.org/punevent-registration/

Event Website: http://www.cmgindia.org/events/event/4th-cmg-india-pune-event/

Please double-check the date/time/venue of the event at the above link. We try to ensure that PuneTech calendar listings are accurate, but occasional errors creep in.

Note: you are currently subscribed to the PuneTech main newsfeed. However, there are lots of technology events happening in Pune every week, and most of those are not posted on the main newsfeed. If you want to be informed by email about all the tech events happening in Pune, you need to separately subscribe to the PuneTech Calendar. It’s free so what are you waiting for? Check out the PuneTech Calendar to get an idea of the kinds of events that you’re missing out on.

Call for Papers/Tutorials: CMG India Conference on Computer Performance Engineering

Events, Featured, , ,

CMG India (Computer Measurement Group) is a group of performance management and capacity management professionals and students in the software industry.

The first annual conference of CMG India will be held in Pune on December 12 and 13. Last year, CMG India had a half day conference in Pune and that was quite successful.

The [call for papers][cmg2104cfp] or tutorials for the CMG 2014 conference is open currently – but it closes on 30th June, so hurry, only 12 days left.

The conference is looking for original submissions of real life experiences, (research) work in progress, tutorials in the following areas:

  • Performance Engineering of IT Systems: Design, Development, and Production System Management
  • Performance & Capacity Modelling
  • Big Data Performance Engineering
  • Cloud Performance Engineering
  • Mobile Systems Performance
  • In Memory Computing: Design and Optimization
  • High Performance Computing
  • Large System Architecture & Design for Performance

For more details of format and what is expected, see the call for papers.

This promises to be a high quality conference – the organizing and program committees consist of people from TCS (TRDDC), Cisco, IIT-Bombay, Intel, Persistent, Accenture, Microsoft and more.

For more details see the CMG India website, the CMG India First Annual Conference 2014 website, and the FAQ for the conference.

CMG Pune half-day conference on Performance, Capacity, Instrumentation, Measurement

Events, Featured, , ,

CMG India, a professionals’ forum for measurement and quantitative analysis in IT enterprises, invites performance engineering and capacity management professionals to their second half-day event in Pune, on Friday, 20th December, 2:30pm, at TCS, Nagar Road. This event is free for anyone to attend. See CMGIndia website for details on how to register.

After a competitive round of paper submissions and stringent review by a technical program committee, the following have been selected for presentation at this event:

Agenda

  • 2:30pm: Welcome Note
  • 2:40pm: A High Performing Scalable Architecture to Instrument Software Applications, Anand Kumar, TCS
  • 3:20pm: Messaging Protocols for Real Time System Data Sharing, Deepti Nagarkar, Persistent
  • 4:00pm: Break
  • 4:10pm: Guerilla Capacity Assessment using USL, Prajakta Bhatt, Infosys
  • 4:50pm: Prize Distribution for 1st Pune Event Quiz Contest & Windup

A High Performing Scalable Architecture to Instrument Software Applications

By Anand Kumar

Software applications have become larger and more complicated in design. This increased complexity and scale in software application design present difficult challenges in asserting software quality. Software instrumentation is an effective solution in measuring and improving a software application’s quality. By examining the data gathered by the various instruments, it is possible to determine the cause for the software application failure and a causal analysis of the context in which the failure happened can lead to improvement in the overall software quality. In this paper, we discuss about a generic instrumentation for software applications which can be used to assert software quality. We also discuss about architecture of this generic instrumentation. We illustrate the capabilities of this generic instrumentation using couple of case studies.

Anand is currently a Senior Scientist at TCS Innovation Labs, Pune with research interests in Architecture, Processes, Systems, and Services. He has two decades of experience in the IT industry spanning across programming, architecture, and research.

Messaging Protocols for Real Time System Data Sharing

By Deepti Nagarkar

An introduction to protocols primarily used to share data for Real time systems along with a brief comparison with each other. Realtime systems have different requirements with respect to data delivery. There are protocols explicitly designed to deliver according to these specifications. Protocols analyzed are – DDS, STOMP and AMQP.

Deepti is currently with Persistent Systems Performance Engineering Group. She has over 6.5 years experience in J2EE across a number of projects and domains. Deepti has done her B.E. Computers from Pune University.

Guerilla Capacity Assessment using USL

By Prajakta Bhatt

Traditional Capacity Assessment exercises come with their own challenges. This paper aims to cover how these challenges can be surpassed using Guerilla techniques, originally proposed by Dr. Neil Gunther. It introduces the concept of scalability and shows how Universal Scalability law (USL) can be employed to model scalability of the Systems realistically, combining both Hardware/Software aspects together. USL aids in arriving at maximum point of throughput, beyond which the system performance degrades. This paper, shows how this theoretical limit can be used to predict capacity of a live database server through a detailed case study.

Prajakta is working as a Technology Architect, in NFRs technical focus group that specializes in Performance Engineering Activities at Infosys. She has over 9.5+ years of experience in software development, project management and Performance Engineering across various domains and technologies of applications. She has done M.S. (Software Systems) from BITS, Pilani and B.E. (CSE) from Govt. College of Engineering, Aurangabad.

About CMG Pune

Computer Measurement Group is a not-for-profit, worldwide organisation of IT professionals committed to sharing information and best practices focused on ensuring the efficiency and scalability of IT service delivery to the enterprise through measurement, quantitative analysis, and forecasting. CMG Inc, which is headquartered in New Jersey, USA was setup in 1975 and it now has more than 25 US and International Chapters.

CMG India has been recently setup with the objective of networking performance engineering and capacity management professionals across India. Large IT systems across India need to process millions of transactions per day and CMG India will allow for the experts to share their experiences and learn from one another. The facilitation will be done through regional events across major cities, an annual conference, and posting technical articles on this site.

See the CMG India website for more information.

Fees and Registration

Seating capacity is limited. Event participation is only for CMG India members – but you can sign up for a free membership here. Members can register for this event by sending an email to pune-events@cmgindia.org from their registered email ids. For details about the venue contact Abhay_Pendse@persistent.co.in

Event Website: http://www.cmgindia.org/events/event/2nd-cmg-india-pune-event/

Please double-check the date/time/venue of the event at the original website/registration link. We try to ensure that PuneTech calendar listings are accurate, but occasional errors creep in.

Note: you are currently subscribed to the PuneTech main newsfeed. However, there are lots of technology events happening in Pune every week, and most of those are not posted on the main newsfeed. If you want to be informed by email about all the tech events happening in Pune, you need to separately subscribe to the PuneTech Calendar. It’s free so what are you waiting for? Check out the PuneTech Calendar to get an idea of the kinds of events that you’re missing out on.

TechWeekend7 (#tw7): Mobile Application Development – 19 Feb

Events, , , , ,

TechWeekend 7 (#tw7) will focus on Mobile Application Development, and we have these talks lined up:

  • Application Development for Windows Phone 7 & Marketplace – by Mayur Tendulkar. With Nokia throwing all its weight behind Windows Phone 7 for all its smartphones, Windows Phone 7 has suddenly become a much more important platform than it was before. Get an overview of what Windows Phone 7 is in this talk. Mayur works on various mobile and location aware technologies at Zevenseas India. Click here for Mayur’s full background
  • Cross-Platform Mobile Application Development – by Rohit Ghatol. With the smartphone market becoming increasingly fragmented, frameworks like PhoneGap and Titanium are becoming popular as means of writing an app just once and deploying it across different mobile platforms. Rohit will talk about his experiences with using PhoneGap/Titanium, and will also touch upon how you could create your own cross-platform framework. Rohit is an associated architect for QuickOffice – the mobile office software suite. Click here for Rohit’s full background
  • Performance Tuning for Android Applications – by Anand Hariharan. Performance is a very critical factor for success of a mobile app, since cellphones are still under-powered as compared to the desktops. This talk will cover Java/Android performance tips, best practices; benchmarking and tracing tools, and what areas to look at in your app for improving performance. Anand is Director of Engineering–Product Development at the India office of Android-based tablet software maker TapNTap. Click here for Anand’s full background
  • Using HTML5/CSS3 for Mobile App development – Arnab Chakraborty. HTML5 is fast becoming an alternative to native apps for mobile app development. This talk will cover the specific features of HTML5 and of CSS3 that make it appropriate for development of mobile apps. Arnab is a senior developer at Thoughtworks. Click here for Arnab’s full profile

This event is free and open for anybody to attend. Please register here

About Techweekend

TechWeekend Pune is a volunteer run activity. TechWeekend talks are held on the 3rd Saturday of every month from 10am to 2pm at Sumant Moolgaonkar Auditorium, Ground Floor, ICC Trade Center, SB Road. Each TechWeekend event features 3 or 4 talks on advanced technical topics. These events are free for all to attend. See PuneTech articles about past techweekends to get an idea of the events.

Join the techweekend mailing list to keep in touch with the latest TechWeekend activities.

About the Sponsor – Microsoft

Many thanks to Microsoft for sponsoring the venue for Techweekend. Microsoft wants to get more closely involved with the tech community in Pune, and particularly the open source enthusiasts – with the intention of making everybody aware that their cloud technologies (like Azure) actually play well with open source, and that you can deploy your php applications, your drupal/joomla installs on Azure.

Register

This event is free and open for anybody to attend. Please register here

Web Scalability and Performance – Real Life Lessons (Pune TechWeekend #3)

In Depth, Live Blogging, Technology, , , ,

Last Saturday, we had TechWeekend #3 in Pune, on the theme of Website Scalability and Performance.  Mukul Kumar, co-founder, and VP of Engineering at Pubmatic, talked about the hard lessons in scalability they learnt on their way to building a web service that serves billions of ad impressions per month.

Here are the slides used by Mukul. If you cannot see the slides, click here.
Web Scalability & Performance

The talk was live-tweeted by @punetechlive and @d7ylive. Here are a few highlights from the talk:

  • Keep it simple: If you cannot explain your application to your sales staff, you probably won’t be able to scale it!
  • Use JMeter to monitor performance, to a good job of scaling your site
  • Performance testing idea: Take 15/20 Amazon EC2 servers, run JMeter with 200threads on each for 10 hours. Bang on your website! (a few days later, @d7y pointed out that using openSTA instead of JMeter can give you upto 500 threads per server even on old machines.)
  • Scaling your application: have a loosely coupled, shared nothing, stateless, distributed architecture
  • Mysql scalability tip: Be careful before using new features, or new versions. Or don’t use them at all!
  • Website scalability: think global. Some servers in California, some servers in London, etc. Similarly, think global when designing your app. Having servers across the world will drive architecture decisions. When half your data-center is 3000 miles from the other half, interesting, non-trivial problems start cropping up. Also, think carefully about horizontal scaling (lots of cheap servers) vs vertical scaling (few big fat servers)
  • memcache tip: pre-populate memcache with most common objects
  • Scalability tip: Get a hardware load balancer (if you can afford one). Amazon AWS has some load-balancers, but they don’t perform so well
  • Remember the YouTube algo for scaling:
    while(1){
    identify_and_fix_bottlenecks();
    eat_drink();
    sleep();
    notice_new_bottleneck();
    }
    there’s no alternative to this.
  • Scalability tip: You can’t be sure of your performance unless you test with real load, real env, real hardware, real software!
  • Scalability tip – keep the various replicated copies of data loosely consistent. Speeds up your updates. But, figure out which parts of your database must be consistent at all times, and which ones can have “eventual consisteny”
  • Hard lessons: keep spare servers at all times. Keep servers independent – on failure shouldn’t affect other servers
  • Hard lessons: Keep all commands in a script. You will have to run them at 2am. Then 3am. Then 7am.
  • Hard lessons: Have a well defined process for fault identification, communication and resolution (because figuring these things out at 2am, with a site that is down, is terrible.)
  • Hard lessons: Monitor your web service from 12 cities around the world!
  • Hard lesson, Be Paranoid – At any time: servers can go down, DDOS can happen, NICs can become slow or fail!

Note: a few readers of of the live-tweets asked questions from Nashik and Bombay, and got them answered by Mukul. +1 for twitter. You should also start following.

Related articles by Zemanta
Reblog this post [with Zemanta]

TechWeekend #3: Website Performance, Scalability and Availability: Sept 5

Events, , , ,

Scalability (Source: Domas Mituzas, Wikipedia)
Click on the image to see other PuneTech articles on Scalability (Image Source: Domas Mituzas, Wikipedia)
What: TechWeekend featuring “Website Scalability and Performance” by Mukul Kumar, VP Engineering at Pubmatic, and “Website Availability and Recovering from Failures and Disasters” by Sameer Anja, Associate Director at KPMG
When: Saturday, 5th Sept, 4pm
Where: Symbiosis Institute of Computer Studies and Research, Atur Centre, Model Colony. Map.
Registration and Fees: This event is free for all to attend. Please register here.

Website Scalability and Performance – Mukul Kumar

Mukul will talk about the various aspects of what it takes to run a very high traffic website – something that he has a lot of experience with at Pubmatic, the ad optimization service for web publishers, where they serve over a billion requests per month.

Mukul Kumar (mukul.kumar [at] pubmatic [dot] com) is a Co-Founder and VP of Engineering at Pubmatic, and Mukul is responsible for PubMatic’s engineering team and resides in Pune, India. Mukul was previously the Director of Engineering at PANTA Systems, a high performance computing startup. Previous to that he joined VERITAS India as the 13th employee and helped it grow to over 2,000 individuals as Director of Engineering for the NetBackup group, Veritas’ main product. He has filed for 14 patents in systems software, storage software, and application software and proudly proclaims his love of Π and can recite it to 60 digits. Mukul is a graduate of IIT Kharagpur with a degree in electrical engineering.

Website Availability and Recovery from Disasters – Sameer Anja

While everyone looks at security and focuses on confidentiality, privacy and integrity; an oft neglected parameter is of availability. While “neglected” may be seem like a strong term, the truth is that we overlook basic data on availability and do not even implement simple to-dos which would help in remediating the situation. The session is aimed at identifying such simple remedies, look at impacts, the assessment model and put forward various scenarios and possible solutions available. The session does not focus on specific products and instead endeavours to use existing technologies used for web site development and how they can be used for ensuring availability. Some principles of disaster recovery will also be covered.

Sameer is a Senior Manager in the IT Advisory practice and is working with KPMG since January 2007 and has 12+ years of work experience in the areas of Information Security, Product design and development, system and network administration. Worked on process and technology areas of Information Security. Worked on Governance and Compliance areas like SOX, Basel II, ISO 15048, SSE -CMM, Data Privacy apart from ISO 27001, Identity Management and Business Continuity design and testing. Experience working with startups and established setups. Speaker at various conferences/ seminars within India and abroad. Trained for six sigma green belt.