(707) 268-8850    Get SUPPORT

Network Management Services Blog

Know Your Tech: A/B Testing

Know Your Tech: A/B Testing

A key component to effectively attracting your audience is to better understand their preferences. Even the most seemingly insignificant change, like changing the color of the buttons on your website, can have a major impact on how effective your materials are. Fortunately, through a process called A/B testing, observing the impact of these changes is somewhat straightforward.

A/B Testing, Defined
Running an A/B test is the process of comparing a single variable to deem which option, Option A or Option B, is the more effective of the two. The key to an effective A/B test is to only change one thing between the two test subjects - otherwise, you have no way of knowing exactly what it was that was the influential change.

A/B tests can be used to make a wide variety of choices, from something as simple as an adjustment to a call-to-action to a different layout to a particular page. In this case, Option A should be the way things currently are to serve as a control for the experiment, while Option B displays your proposed change. Each option is then presented to an equally-sized segment of your audience to deem which of the two is the more effective.

Setting Up an A/B Test
A/B testing can be used to make a vast number of decisions, as long as they are approached one at a time. As we said before, if multiple variables are involved in a single test, that test isn’t going to deliver reliable enough results to make any well-supported decisions. It is also worth mentioning that A/B testing tends to work better when comparing options for relatively minor changes, like calls-to-action or images included in an email or on a landing page, rather than big ones.

The first step will be to decide which variable you intend to test, followed by your determination of a metric to base your observations against. Does this change boost engagement? Increase the time spent on page? Improve your click-through rate?

Once this has been accomplished, you’re ready to state what your control option will be, and what your change will be after that. Your control group should be whatever you currently have in place, so you can accurately judge if a change would be an improvement or not. Then you need to settle on a sample size, or the number of recipients that will be a part of this test.

Not all changes will be accurately measured with a sample size alone. Some changes would be better left running until a statistically significant data sample has been collected. Speaking of statistical significance, you will also need to decide how significant your results have to be before a change is deemed to be worthwhile.

Running An A/B Test
There are two real keys to running a successful A/B test: first, you have to give it enough time to collect the data you’ll need to come to a conclusion, and second, both options need to be tested at the same time to prevent other variables from affecting your data. Of course, if the variable that your A/B test is evaluating is timing, this doesn’t apply so much.

In short, A/B testing is a relatively simple way to make sure that you’re having as large an impact on your audience as possible. Can you think of any times that you’ve done something similar to test out a proposed change? Tell us about it in the comments!

Hackers Target Major Sporting Events
Hackers Plus Artificial Intelligence Equals Big Tr...


No comments made yet. Be the first to submit a comment
Already Registered? Login Here
Sunday, January 20 2019

Captcha Image

Mobile? Grab this Article!

QR-Code dieser Seite

Tag Cloud

Tip of the Week Security Technology Cloud Best Practices Network Security Business Computing Privacy Managed IT Services Hackers Malware Data Backup Innovation Hosted Solutions Backup VoIP Mobile Devices Email Google Data Data Recovery Tech Term Outsourced IT IT Support IT Services Microsoft Cloud Computing Software Saving Money Internet of Things Internet BDR Business Continuity Efficiency Communications Hardware Communication Small Business Cybersecurity Ransomware Cybercrime Business Smartphones Android Artificial Intelligence Server User Tips Disaster Recovery Alert How To Gadgets Browser Network Avoiding Downtime Computers Save Money Managed IT Smartphone Managed IT Services Windows Mobility Two-factor Authentication Social Engineering Law Enforcement Computer Chrome Passwords Phishing Firewall Business Intelligence Collaboration Data Security Data Protection Productivity Windows 10 Router BYOD Vulnerability Applications Miscellaneous Money Social Media Business Management Mobile Device Management Workplace Tips Private Cloud Blockchain Compliance Remote Monitoring Document Management Operating System Connectivity Redundancy Virtualization Budget Productivity Bandwidth Facebook Office 365 Proactive IT IT Support VPN Upgrade Flexibility Spam Identity Theft Managed Service Provider Word Telephone Systems Data Storage Google Drive Holiday Wi-Fi File Sharing Servers Credit Cards Password Training Workers Analysis Business Owner Mobile Computing Managed Service Quick Tips Public Cloud Settings Spam Blocking Employer-Employee Relationship Information Technology Work/Life Balance Apps Data Breach Infrastructure Content Filtering Data storage Microsoft Office Virtual Assistant Sports Data loss Comparison Big Data OneNote IT Management Website Value Hacking Windows 7 CES Networking Office Tips Bring Your Own Device IT Plan Mobile Device Encryption Update Physical Security Access Control Unified Threat Management Automation Content Management Paperless Office Smart Tech App Government Windows 10 Solid State Drive Unsupported Software Information Evernote Authentication Cleaning Netflix Hiring/Firing Health PDF Students Black Market Insurance Data Management Enterprise Content Management Excel Workforce Recycling Wireless Internet Patch Management Root Cause Analysis Remote Worker Botnet Software Tips Humor Google Apps Content Filter Keyboard Augmented Reality FENG Start Menu Computing Infrastructure Google Docs Wireless Charging Nanotechnology Wireless Technology Computer Care Business Technology Flash Files Human Resources Healthcare Current Events Reputation Internet Exlporer Fraud Practices Safety Password Management Tip of the week Telecommuting Apple eWaste Wire Hosted Solution IBM Scam Meetings Wiring Travel Accountants Marketing Hacker webinar Storage The Internet of Things Mobile Knowledge Data Warehousing Voice over Internet Protocol Hybrid Cloud Fiber-Optic Legal Risk Management Samsung Windows 10s Staff Electronic Health Records Education Customer End of Support Amazon Hosted Computing Charger Emails NIST Windows Server 2008 Remote Work Hard Drives iPhone Criminal Recovery Camera History Save Time Conferencing HBO Password Manager Professional Services Monitor Electronic Medical Records Network Congestion Multi-Factor Security Cables Devices Telephone System Sync Digital Signature Machine Learning Internet exploMicrosoft Amazon Web Services Inventory HaaS Cryptocurrency Smart Office Screen Mirroring Software as a Service IoT Outlook Specifications Business Mangement Addiction CrashOverride Tools IT Consultant Trending Office Unified Communications Thought Leadership HIPAA Audit Telephony Cortana YouTube Advertising Online Shopping Entertainment Safe Mode Regulations Supercomputer Cast User Error HVAC Frequently Asked Questions Millennials Gmail Cache USB Emergency Downtime MSP Leadership Lifestyle Relocation Theft Streaming Media SaaS Computer Fan Skype Colocation Strategy WiFi Presentation Lithium-ion battery Instant Messaging Troubleshooting Managing Stress Computer Accessories Fun Video Games 5G Battery Tech Support Two Factor Authentication Techology Vendor Management How to Bluetooth Remote Computing Experience Assessment Proactive Administration Content Competition Customer Relationship Management Transportation IP Address Search Twitter Scalability Music Books Television Remote Monitoring and Maintenance Best Practice Politics Users Audiobook Webinar Shadow IT Customer Service Benefits Printers Mobile Office Worker Wearable Technology Public Computer Line of Business Virtual Reality Domains Loyalty Regulation Wireless IT solutions Smart Technology Automobile Rootkit Company Culture Worker Commute Employer Employee Relationship Public Speaking