(707) 268-8850    Get SUPPORT

Network Management Services Blog

Know Your Tech: A/B Testing

Know Your Tech: A/B Testing

A key component to effectively attracting your audience is to better understand their preferences. Even the most seemingly insignificant change, like changing the color of the buttons on your website, can have a major impact on how effective your materials are. Fortunately, through a process called A/B testing, observing the impact of these changes is somewhat straightforward.

A/B Testing, Defined
Running an A/B test is the process of comparing a single variable to deem which option, Option A or Option B, is the more effective of the two. The key to an effective A/B test is to only change one thing between the two test subjects - otherwise, you have no way of knowing exactly what it was that was the influential change.

A/B tests can be used to make a wide variety of choices, from something as simple as an adjustment to a call-to-action to a different layout to a particular page. In this case, Option A should be the way things currently are to serve as a control for the experiment, while Option B displays your proposed change. Each option is then presented to an equally-sized segment of your audience to deem which of the two is the more effective.

Setting Up an A/B Test
A/B testing can be used to make a vast number of decisions, as long as they are approached one at a time. As we said before, if multiple variables are involved in a single test, that test isn’t going to deliver reliable enough results to make any well-supported decisions. It is also worth mentioning that A/B testing tends to work better when comparing options for relatively minor changes, like calls-to-action or images included in an email or on a landing page, rather than big ones.

The first step will be to decide which variable you intend to test, followed by your determination of a metric to base your observations against. Does this change boost engagement? Increase the time spent on page? Improve your click-through rate?

Once this has been accomplished, you’re ready to state what your control option will be, and what your change will be after that. Your control group should be whatever you currently have in place, so you can accurately judge if a change would be an improvement or not. Then you need to settle on a sample size, or the number of recipients that will be a part of this test.

Not all changes will be accurately measured with a sample size alone. Some changes would be better left running until a statistically significant data sample has been collected. Speaking of statistical significance, you will also need to decide how significant your results have to be before a change is deemed to be worthwhile.

Running An A/B Test
There are two real keys to running a successful A/B test: first, you have to give it enough time to collect the data you’ll need to come to a conclusion, and second, both options need to be tested at the same time to prevent other variables from affecting your data. Of course, if the variable that your A/B test is evaluating is timing, this doesn’t apply so much.

In short, A/B testing is a relatively simple way to make sure that you’re having as large an impact on your audience as possible. Can you think of any times that you’ve done something similar to test out a proposed change? Tell us about it in the comments!

Hackers Target Major Sporting Events
Hackers Plus Artificial Intelligence Equals Big Tr...


No comments made yet. Be the first to submit a comment
Already Registered? Login Here
Wednesday, September 19 2018

Captcha Image

Mobile? Grab this Article!

QR-Code dieser Seite

Tag Cloud

Tip of the Week Security Technology Cloud Best Practices Network Security Business Computing Privacy Managed IT Services Hackers Malware Data Backup Innovation Backup VoIP Hosted Solutions Google Mobile Devices Email Data Recovery Outsourced IT Tech Term IT Support Data Software Internet of Things Cloud Computing Saving Money Microsoft BDR IT Services Business Continuity Efficiency Hardware Internet Communications Small Business Business Cybercrime Cybersecurity Ransomware Android Artificial Intelligence User Tips Smartphones Communication Disaster Recovery Alert Managed IT Services Smartphone Gadgets Windows Browser Avoiding Downtime Save Money How To Managed IT Network Server Computers Business Management Data Security Data Protection Windows 10 Collaboration Productivity Vulnerability Router BYOD Social Engineering Chrome Law Enforcement Phishing Firewall Miscellaneous Applications Social Media Mobile Device Management Two-factor Authentication Business Intelligence Mobility Passwords Money Redundancy Managed Service Provider Budget Document Management Private Cloud Compliance Office 365 Identity Theft Facebook Blockchain Upgrade Remote Monitoring Word Productivity Virtualization Operating System Spam Flexibility Bandwidth Workplace Tips Telephone Systems Proactive IT Computer Connectivity IT Support VPN File Sharing Business Owner Automation Apps Unified Threat Management Physical Security Information Technology Data loss Work/Life Balance CES Government Managed Service Comparison Microsoft Office OneNote IT Management Encryption Google Drive Content Management Paperless Office Training Workers Windows 7 Big Data Access Control Quick Tips Website Smart Tech Virtual Assistant Employer-Employee Relationship IT Plan Settings Public Cloud Update Data Breach Data storage Credit Cards Content Filtering Office Tips Unsupported Software Mobile Device Analysis Data Storage Servers Windows 10 App Infrastructure Mobile Computing Wi-Fi Value Solid State Drive Holiday Hacking Spam Blocking Networking Password Sports Bring Your Own Device Information Password Manager IT Consultant Cortana Keyboard Wireless Technology Office Mobile Remote Worker Data Warehousing Voice over Internet Protocol Safety Digital Signature Machine Learning Advertising Enterprise Content Management Windows 10s IBM Cables Devices Supercomputer Marketing Hacker Smart Office User Error Windows Server 2008 Remote Work Hosted Solution The Internet of Things Amazon Web Services Inventory Emergency Business Mangement Addiction Leadership Colocation HBO IoT SaaS Relocation Business Technology Professional Services Hiring/Firing Health Wiring Multi-Factor Security Legal Risk Management YouTube Cleaning Netflix Password Management Sync Education Unified Communications Thought Leadership Screen Mirroring Software as a Service Recovery Online Shopping Patch Management Gmail Cache Computing Infrastructure Outlook Specifications Humor CrashOverride Tools Save Time Current Events Files Trending Strategy Computer Care NIST Audit Telephony Theft Streaming Media Cast HaaS Students Reputation Internet Exlporer Regulations Evernote Authentication Scam Apple Recycling Wireless Internet webinar Frequently Asked Questions Millennials Insurance Telephone System Downtime Content Filter Knowledge Lifestyle HIPAA Samsung Hybrid Cloud Cryptocurrency Computer Fan Skype Google Apps Entertainment Human Resources Healthcare Charger Emails Customer End of Support Wireless Charging Nanotechnology Hard Drives iPhone eWaste Wire Conferencing Monitor History Excel Workforce USB Fraud Practices Root Cause Analysis Botnet Storage Electronic Medical Records Network Congestion Software Tips Accountants Safe Mode FENG Start Menu MSP Google Docs Staff Electronic Health Records Internet exploMicrosoft HVAC Flash PDF Black Market Fiber-Optic Travel Data Management Criminal Tip of the week Telecommuting Augmented Reality Amazon Hosted Computing Meetings Twitter Video Games 5G Loyalty Tech Support IT solutions Battery Smart Technology Techology Rootkit How to Employer Employee Relationship Remote Computing Experience Competition Customer Relationship Management Content IP Address Proactive Users Computer Accessories Scalability Music Fun Two Factor Authentication Camera Best Practice Politics Company Culture Customer Service Remote Monitoring and Maintenance Audiobook Mobile Office Vendor Management Shadow IT Bluetooth Administration Wearable Technology Domains Assessment Printers Wireless Managing Stress Virtual Reality Line of Business WiFi Transportation Automobile Public Speaking Books Television Search Regulation Presentation Worker Commute Lithium-ion battery Webinar Benefits Worker Instant Messaging Troubleshooting Public Computer