tag:blogger.com,1999:blog-36118108.post1128786756215433349..comments2023-12-06T00:17:28.519-08:00Comments on Creative Chaos: 100% Test AutomationMatthewhttp://www.blogger.com/profile/05956714498778698672noreply@blogger.comBlogger1125tag:blogger.com,1999:blog-36118108.post-18719992822163784152008-04-29T03:41:00.000-07:002008-04-29T03:41:00.000-07:00Matt, you are spot on!! Here I am discussing with ...Matt, you are spot on!! Here I am discussing with one of my colleagues who claims that their team had a great success of automating about 98%. They also feel that this is a program running for past 2-3 years and customer has put his stamp on this.<BR/><BR/>Sales folks take this story and go around telling everyone that 98% of automation has saved 70% of manual testing effort ...<BR/><BR/>I am still need to feel the ground under my feet ... but this is something that these people claim ...<BR/><BR/>When I asked 98% of what? they say 98% of all available test cases have been automated. Further to this since all these test cases have been 100% mapped to requirements(not sure what that means) - hence these test cases *symbolically* represent 100% application functionality (assuming that what is in requirements has been implimented in best possible ways) ... In effect they say they have been able to automate about 98% of testing ... Tall claim. This application is a desktop application and is pretty stable application.<BR/><BR/>As I dig more on this .. I just told them one thing ...<BR/><BR/>Do you know what will *loose* if you automate a test? In that context what would an automation to the tune of 98% mean? only 2% human testing ....<BR/><BR/>For that they say ... "Yes .. application is pretty stable. Automation has proved highly useful"<BR/><BR/>What do you say? What are problems with such large percentage of automation .. whatever may be the denominator ... 98% is HIGH and SCARY ...<BR/><BR/>What would be your questions if someone claims 98% automation?<BR/><BR/>ShriniShrini Kulkarnihttps://www.blogger.com/profile/10782753752478547381noreply@blogger.com