Cordny

Do you remember the macOS antiforensics course I designed with eForensics Magazine last year?

Well, it is now running for a year and it is still going strong.

Many infosec enthusiasts followed the course and have given me great feedback via eForensics Magazine and LinkedIn.

Thank you all!

Can I still apply for the MacOS antiforensics Course?

Don’t worry, you can still apply for the course and follow it in your own pace.

Have a look, as already said, it is a self-paced practical, easy-to-read online course with lots of visuals and videos. And it’s fun!

A new infosec course by Cordny?

Who knows?

Maybe another macOS course, or antiforensics tooling?

I keep you posted!

Have a great and fun 2020!!!

Test automation is an important part of my work at TestingSaaS.

Ever since I started software testing I was intrigued by automating it and finding a great tool doing this.

This journey took some time, but I found a great partner delivering me the tools to do some awesome test automation: Sauce Labs

What is Sauce Labs?

Sauce Labs ensures the world’s leading apps and websites work flawlessly on every browser, OS and device. Its award-winning Continuous Testing Cloud provides development and quality teams with instant access to the test coverage, scalability, and analytics they need to deliver a flawless digital experience. Founded by the original creator of Selenium (woohoo!), Sauce Labs helps companies accelerate software development cycles, improve application quality, and deploy with confidence across hundreds of browser / OS platforms, including Windows, Linux, iOS, Android & Mac OS X. Optimized for Continuous integration (CI), Continuous delivery (CD), and DevOps, the Sauce Labs platform is built to handle the most secure data from its customers, who range from Fortune 500 companies to small businesses worldwide. To date, nearly 2 billion tests have run on the Sauce Labs cloud.

TestingSaaS and the Sauce labs test automation software

As a software tester I use a lot of Selenium for automated web testing. But I also use Sauce Labs to test other applications:

• Real-device testing
• Chatbot testing (together with Botium)
• AIOps
• Mobile app testing
• Contract testing with PostMan

And, as you can see, because I like to write about software, I also take my readers along my journey. After all, my mission is to ‘Create Content by Testing‘.

Thank you Fixate and Sauce Labs for joining me on this journey.

TestingSaaS and test automation in 2020

Test automation is a fast evolving field.

Artificial Intelligence is getting more and more important in today’s information technology. And what to think of all the new mobile devices?

How can we use test automation so tests can be done in time to market and ensure the quality of the systems under test?

Enough to test (automate) and write about in 2020.

TestingSaaS will continue its ‘Create Content through Testing‘-journey with the help of Fixate, Sauce Labs and its partners.

So, do you want to join my journey?

As a content marketeer I work a lot with Content Management Systems, also known as a CMS.

A lot of these CMS are online available and therefore can be tested very easily. Take for example WordPress. If I find a bug I can share it with the WordPress community very quickly and actions can be taken.

Did you know TestingSaaS partnered with SpotOn to test and market their CMS for Augmented and Virtual Reality?

In my last blog I already discussed this when reporting about Adobe Aero.

Content delivered via AR/VR is going to be booming in 2020.

My mission in 2020 is to test the AR/VR Content Management Systems and monitor their quality.

And make first class content of course for my clients.

Do you want to join me in my mission?

Last week, November 4, 2019, Adobe launched its AR Authoring app, Adobe Aero. Awesome, what is it and what can you do with it?

AR is getting more noticed by the big tech companies. One of these is Adobe.

Adobe first demoed its Aero AR authoring app last year at the Adobe Max event, and recently, November 4th, it launched it to the public.

What is Adobe Aero?

Adobe Aero is Adobe’s answer to designing AR without coding.

Aero is the first tool that allows designers to build and share immersive experiences in AR—without any coding skills.

If it’s the first AR no coding-tool, I wonder. But that’s another blog.

I already mentioned it is freely available to the public.  As long as you have iOS, a free mobile iOS app for phones and tablets is available.

But before going to public a private betatesting program was set up. During this beta, Adobe received participation from thousands of users within the creative community. Adobe also launched the Adobe AR Residency program to collaborate with the creative community for building the best tool available.

So, what features were developed during this betatest?

• Intuitive authoring – No coding necessary. all steps done via easy-to-follow instructions
• Animation – Objects can be placed by using your hands and device. This combined with triggers gives a great animation.
• Assets at your fingertips – Hundreds of free starter assets available right in the app, including the option to import a broad set of 2D/3D file format (vector graphics, Adobe Photoshop files, OBJ, FBX, Collada, glTF, etc.)
• Easy publishing and sharing – sharing your AR product directly on social media or sending the experience to others via the Aero app.

What can you do with it?

Developing AR without coding brings Media to the next level. Media artists are no longer dependent on programmers to do the coding for them. Now they have a platform for this.

Digital is no longer confined to a single screen – it’s permeating throughout physical spaces and the real world.

Artists can also add interactive experiences by drawing the path of motion for an object to follow.

It’s the next step for Adobe. From Photoshop for graphic design to Aero for the Augmented Reality space.

The era of Augmented Reality CMS has begun. There are more examples of AR CMS on the market. Remember, this is just the beginning.

TestingSaaS will monitor this evolution and keep you updated.

Smart speakers are trendy in 2019. Especially smart speakers with virtual voice assistants are booming.

But what challenges do the manufacturers of these smart speakers face with user adoption of its virtual voice assistants?

This blog will discuss 3 of these challenges.

Remember the Eighties Hit series The Knight Rider where The Hoff could communicate with his car by voice?

This is not science fiction anymore.

Smart speakers with built-in virtual voice assistents are booming and it is now possible to instruct your smart speaker to enable specific activities like playing your Spotify list, ordering food or groceries or read out loud the daily news and weather. How convenient is that?

However, some challenges have to be addressed to enable user adoption for voice assistance.

Installation and Customer Experience of a Voice Assistant

Building a smart speaker with voice assistance is not easy in this crowded consumer market.

is it not already there? Does the consumer really need it?

Do you have to be a whizz kid to install it and afterwards? How many times do I really use it?

Just a few of the questions a manufacturer has to ask himself before putting the product on the market.

If he can’t answer these questions there is a real big chance the consumer won’t like the product and it can become a financial disaster.

Voice Assistants and Brand independence

Great, you have a couple of smart devices in your home and, for convenience, you expect them to communicate together.

Not every person wants all devices from a specific brand, say Samsung, but also from Google Home or Amazon Alexa.

If you want a great user adoption you have to ensure your device is compatible, also with voice assistance.

Voice Assistants and User Privacy

Data and user privacy is an important field a voice assistant manufacturer has to deal with.

Online clicking is different than voice data, Why?

First, voice is biometric and can be used to identify a person, like a finger print or a retina scan. Next to this, it can also identify a person’s mood or even his mental state.

This is quite different than to know which button this person clicked.

Also the environment the smart speaker is in, should be taken in account. These are personal, intimate surroundings, your own home. Remember the recent disturbing news of smart devices listening unnoticed.

The user needs to know he is safe and his privacy is not violated, otherwise user adoption is certainly a bridge too far.

As you know, I am testing WeChat at the moment. One of its features I am curious about is the WeChat shake functionality.

What value can this give to the user and is there a business case?

I will discuss this in this article.

What is WeChat shake?

When this feature is selected, just shake your phone. You will be connected to someone else in the world who is shaking his/her phone at the same time. Then you can choose to ignore or respond to this user.

The value

WeChat shake can be a great way to meet new people while using your phone. This can help user feel less lonely.

But is there also a commercial use case?

duplicating the Chinese digital ecosystem in Europe

In China WeChat shake is very popular and not only because it helps against loneliness.

There is also a commercial benefit. In shops where the WeChat shake-logo is present, customers with the WeChat app can shake their phone and then get the offers/coupons from this store on their phone. This is already present and used a lot in far away China, but also will be implemented in Europe.

It seems this feature of WeChat is based on iBeacon-solution, but I am not sure yet, because recent online documentation is scarce on this part. So this will be a future research project.

Let’s see how this implementation of WeChat shake will continue in Europe and if the Chinese tourists will use it.

To be continued ….

A TestingSaaS guestblog on A/B testing by Ilan Nass, Chief Strategist Taktical Digital

Facebook is a valuable marketing tool. With approximately 2.38 billion active monthly users, the platform gives you access to many potential leads.

But if you think Facebook Ads are something you can set and forget, think again. To get results you desire for a sane amount of ad spend, you need to study your results and optimize accordingly. There are a lot of metrics to track when it comes to creating ad campaigns that slice through the noise. Once you’ve decided on a smart metric, it’s time to design an A/B test. This simply involves testing multiple versions of an ad or campaign to determine which is most effective. The following points will help you better understand how to go about this process on Facebook.

What Not to Do

Before exploring how to properly A/B test, it’s important to brush up on mistakes you should avoid. They include:

• Testing too much content at the same time: If you test too many ads or pieces of content at once, it will be difficult for you to confidently identify which content yielded results, and which failed.
• Testing minor changes: When A/B testing ads, they should be different enough that you can glean genuine insights from their performance. Simply changing one line in an ad isn’t enough to help you understand what does and doesn’t work.
• Not providing equal opportunities: You need to design your test so that both ads involved have the same opportunity for success. For instance, if one had a higher budget or was targeting a stronger audience, it might outperform the other, despite not truly being any better.

Instead, follow these tips to A/B test effectively:

Only Test a Single Element

Again, it’s important that your ads be noticeably different when A/B testing on Facebook. That doesn’t mean you should make every element different. You’re better off changing one element when generating multiple versions of the same ad. Change the ad copy, or the image, or the audience, etc. While the changes need to be substantial enough to make a difference, they do need to be restricted to a single element.

Don’t Test Merely Two Ads

The name “A/B testing” implies testing only two versions of a given ad at a time. In some instances, this may be appropriate, but you can often get more valuable insights if you test three to five versions of an ad. When doing so, you may want to make the ads significantly different.

For example, maybe you’re running an ad promoting a product. One ad may feature an image in which the product is foregrounded, with accompanying text explaining its features and benefits. Another ad may include minimal text, with an image that shows the product in action. Yet another might include substantial text in the image, with the product itself taking up less space. This gives you three ads that are different enough from each other to offer valuable information.

Don’t Draw Conclusions Right Away

You need to give your ads a sufficient amount of time to reach users before drawing any conclusions. For example, if you ran an ad asking people to sign up for your email newsletter, with one slightly outperforming the other after a week has elapsed, you might assume that ad is stronger. Although this may be true, it’s smarter to wait two or three weeks to start analyzing data. The more data you have, the more confident you can be in your insights.
Keep in mind that A/B testing does require you to invest some time and money. However, in the long run, the value is worth the investment. Knowing what types of Facebook ads resonate with users is key to optimizing your return-on-investment.

Do you also want to guestblog on TestingSaaS?

Contact me now and let’s start blogging.

Testing the messaging-app WeChat outside China is not easy.

This article shows my experiences with WeChat while I use it in the Netherlands.

What is WeChat?

WeChat (Wēixìn; literally: ‘micro-message’) is a Chinese multi-purpose messaging, social media and mobile paymentapp developed by Tencent. In China it is known as Wēixìn (‘micro-message’).

It was first released in 2011, and became one of the world’s largest standalone mobile apps in 2018, with over 1 billion monthly active users.

That’s a lot of users and that’s why I am interested in this app. Why is it used that much? Ok, there are a lot of Chinese people, but is that the main reason?

Can I, as a non-Chinese, download it on my iPhone and use it in the Netherlands?

Downloading WeChat

WeChat is freely available in the Apple App Store and can be downloaded from there on your iPhone.

Onboarding WeChat

Onboarding is very easy when you use the following steps

Here is the list of these steps:

• Register your account
• Add your friends
• Basic usage WeChat

The steps are pretty straightforward. Mind you, it is a Chinese app, don’t get discouraged by seeing Chinese characters.

My experiences with testing WeChat

I downloaded the WeChat 7.0.5 version on my iPhone 7 with software version 12.4.

Adding friends was not hard. You can look in your mobile contacts who use WeChat, and afterwards you can add them. You can also ask for help by chatting with the WeChat Team.

Group chatting is also a feature. And you can search and manage your contacts by using tags, which is handy when you have personal and business contacts like me.

An interesting feature for me to test is the WeChat Pay, which is the Chinese competitor of Alipay. It seems I have to do additional steps to enable this within WeChat. That’s for another time. There are more than enough other features to test.

One of these features, which could be of value is the Discover tab. With the Discover tab I have access to Moments, a QR code scanner, Shake, People Nearby and a Search-facility for moments, articles and official accounts. It seems you can also have access to WeChat Games, but I did not have this feature.

Let’s investigate the items of the Discover tab.

WeChat – Moments

Moments is the social feed of your friends updates. Here you can place photos or videos, including a cover photo. All photos can be retrieved from the iPhone photo album, or you can take a picture or video. With every photo/video you can add a remark, location (you get a list of nearby places), mention a WeChat comment or share it with your WeChat contacts. Because WeChat is a social app, you can also like or comment a photo.

Funny thing is, when opening your iPhone photo album, Chinese characters are shown in your photo titles.

WeChat – Scan

With the feature Scan you can scan a QR code and even align Chinese/English text and make a photo of this – the translate function.

Both features I tried and it works well, although I can not be sure the English text is translated in correct Chinese.

WeChat – Shake

When this feature is selected, just shake your phone. You will be connected to someone else in the world who is shaking his/her phone at the same time. Then you can choose to ignore or respond to this user.

I tried it and it works. Crazy feature, because you never know who is also shaking.

WeChat – Search

Regarding the Search-facility, this seems interesting, because the search results show a lot of Chinese characters. It is surely curated by WeChat. But that’s for another investigation, another article.

WeChat – People Nearby

With this feature you can browse and connect to WeChat users nearby. I have to dig in deeper to see what I can do with this.

Wrap-Up

This article showed you my first experience with testing WeChat.

WeChat is truly a multi-purpose messaging app and I will certainly test more of its features.

I only have to work on my Chinese characters, because there are a lot of them in this app. Or should I use the WeChat translate function?

Stay tuned for more TestingSaaS testing WeChat articles.

As promised in my previous blog, I am going to share my knowledge on how to test a chatbot.

Manually testing a chatbot is laborious and takes a lot of time. But are there any chatbot test automation tools? Yes, there are. Meet Botium.

Botium – an introduction

To solve the problem of manually testing a chatbot Botium was created. It is an open source testing tool which bills itself as the “Selenium for Chatbots” . Botium allows testers to automate the testing of chatbot behavior using APIs. Tests can be executed in seconds, and they are easily repeatable with every software update.

Botium even provides a total management toolbox with predefined test environments and test sets with thousands of instant runnable tests.

Botium – how to test a chatbot

Sauce Labs offers a cloud based Selenium Server which can connect with Botium. Together with Sauce Labs I wrote a blog describing new testing tools like Botium, which are making it easy to execute automated tests for AIOps applications like chatbots.

Botium was the first tool I used for automating my chatbot tests and it is now an important member of my software testing tool stack.

In the Sauce Labs blog I discuss the following steps using Botium:

1. Connect to Chatbot
2. Select Test Sets
3. Select Test Environments

This Sauce Labs blog is a great starting point to learn and use Botium.

Mind you, in this blog I do not explain how to connect the Sauce Labs Selenium Server with Botium. That is another how-to which you can find in the Further Reading section below.

Wrap Up

New testing tools like Botium are helping to address the challenges of testing chatbots by making it easy to execute automated tests for chatbot applications. As Chatbots grow in importance, automated testing solutions will remain critical for ensuring that Chatbots actually do what their designers intend.

Further Reading

http://www.botium.at/

https://saucelabs.com/blog/you-cant-have-aiops-without-automated-testing

https://github.com/codeforequity-at/botium-connector-webdriverio/blob/master/README.md

Testing chatbots is one of the things I like to do in my pastime. And it is not hard to do. When you have a Facebook account you can use the Facebook Messenger. And what about WhatsApp or WeChat? Also, a lot of companies use chatbots to talk to their customers online.

Sharing my chatbots knowledge

During the testing my knowledge about the chatbots increased. Having this knowledge is nice, but why not share this knowledge? Sharing is caring! A lot of information can be found online, but it is scattered and not always complete. Or even completely wrong. Not every chatbot uses artifical intelligence for instance.

That’s why I am going to give away some free stuff. I will take you in my journey of testing chatbots and share my experiences. This shared content can be commercial or technical, but always with a sharing message in mind. For me it is all about educating my readers on chatbots.

What can you expect?

Sharing knowledge about chatbots sounds good, but what knowledge will be shared?

Expect the coming months answers to the following questions:

1. Chatbot product comparison (WeChat vs. WhatsApp etc.)
2. Deepdive in a chatbot product (Google DialogFlow, Azure Information Bot, etc.)
3. Where are chatbots applied?
4. What kind of chatbots are there?
5. What kind of chatbot frameworks are there? (Watermelon, ManyChat etc.)
6. Chatbot framework comparison
7. Deepdive in a chatbot framework

Answers to these questions will be blogged monthly on TestingSaaS.

Remember this post? Well, now you know what TestingSaaS aka The Marco Polo of SaaS will do the coming months.

Do you want to know more?

Chatbot documentation is not the only service TestingSaaS delivers.

Do you need a manual for your (SaaS) software, a blog, a whitepaper or even an FAQ?

Feel free to contact TestingSaaS here and let’s talk!