Sixteen:Nine - All Digital Signage, Some Snark
ACE Roundtable: The Tech That Worked In 2020, And Going Forward

ACE Roundtable: The Tech That Worked In 2020, And Going Forward

January 27, 2021

The 16:9 PODCAST IS SPONSORED BY SCREENFEED – DIGITAL SIGNAGE CONTENT

Just before Christmas, I moderated an Advocates for Connected Experiences roundtable that tossed around thoughts on what technologies were used to get us all through 2020, focusing on what really worked, and will continue to work into 2021.

It was a video discussion on Zoom, but it translates nicely to audio. I had technical issues with the planned podcast for this week, but this is a worthwhile, albeit last-minute stand-in.

The first voice you hear is Kim Sarubbi, one of the founders of Advocates of Connected Experiences, or ACE.

Also on the discussion, Joe' Lloyd from AVIXA, Kym Frank from Geopath, Beth Warren from CRI and the DSF, Cybelle Jones from SEGD, Bryan Meszaros from OpenEye Global, Asif Kahn from the Location-Based Marketing Association, and myself.

This podcast is produced with the kind, ongoing support of ScreenFeed, the digital signage content store. Get awesome-looking, engaging and automated subscription content for your screens.

 

Jackie Walker, Publicis Sapient

Jackie Walker, Publicis Sapient

December 16, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

There is a long history of very large companies of all descriptions finding their way into the digital signage industry, but they have tended to come in with fanfare and then exit quietly out a side door.

Often, the digital signage effort is a bit of a skunkworks that doesn't have a lot of energy behind it within giant companies that do a 1,000 other things.

That does not appear to be the case with Publicis Sapient, a giant interactive agency that has offices all over the world, 20,000 staffers, and a product and service called Premise, that does digital signage among a bunch of things.

The company has been working on it for 10 years, and has some very big, but unnamed clients using a platform that is all about data and speaks directly to the concept of omnichannel and the goal of producing content once and publishing to many devices and platforms.

Jackie Walker has been working on Premise since it was just a notion, and is what they call the capability lead. We had a great chat about the roots of Premise, how the team works with clients, and the present and future of signage, which is all about APIs, data and the end of walled software gardens.

Subscribe to this podcast: iTunes * Google Play * RSS

TRANSCRIPT

Hi, Jackie, we haven't met in person, but it's great to meet you virtually. I have certainly known about Publicis for many years at Sapient and when you were dabbling or when the company was dabbling in signage through Sapient Nitro. So I was intrigued recently when I saw a press release about Sapient and a platform called Premise, and I wanted to find out all about it, and you're the product manager (product lead) on it? 

Jackie Walker: That's right. I have been working on it for the last 11 years, so I am very close to the solution. 

This is your baby. 

Jackie Walker: This is my firstborn, yep. 

Is it temperamental? 

Jackie Walker: Yes. I have had two human babies since, but this is the one. 

Okay, let's go to the very basics of it. What is it? 

Jackie Walker: Yeah. So let me tell you who we are first, for those of your listeners who don't really know who we are. The Publicis group is, of course, one of the largest media holding companies in the world, with about 80,000 employees. A few years ago, Sapient, which was an independent company, was acquired by Publicis.

So now we are Publicis Sapient. We're about 20,000 employees, in 53 offices worldwide and in terms of our capabilities, we’re basically the digital transformation hub of Publicis group. So we think about strategy, consulting, customer experience, and then agile engineering, and so about half of our people are really technologists and engineers. And we think about how we digitally enable our clients in terms of both, the way that they work and also the way that they serve their customers. So pretty broad scope. 

I've been with the company for over 10 years. This was my first project. It wasn't called a Premise when I joined, and really what we were trying to do was, back then, that was when everybody was just learning how to spell omnichannel and put it on a PowerPoint slide, and really my first project was, we called it the Super Secret Airport Project and back then the idea was to take the airport space (because it is a slightly underserved market) and really think about how we fleshed out an omnichannel solution. So we built this end to end platform that was all about content management, real-time data, airport flight data, and built the solution that would enable our clients to drive their websites, their mobile applications, and then later digital signage from one common platform.

So that was really the frame. 

Was this driven by a client ask or was this like a hole in the market that you guys thought you could fill? 

Jackie Walker: I think it was a “hole in the market”/”wouldn't it be cool if”, right? So there was a group of people in Boston, the spouse of one of our team members who worked for SH&E, an airport consultancy, and they were talking about the ways that airports really struggled to communicate consistently with their customers across channels, right? Back then it was not uncommon that an airport would be operating 3-5 content management systems for each of their individual platforms, and so the idea was that we should consolidate this, right? We have a unique point of view, we have a skillset to do all of this, website development, app development, content management, system development from an enterprise lens. Let's see where this goes. And then we started signing up airports to actually deliver some of those capabilities.

Now, is it in the DNA of the company to build your own platforms as opposed to partnering? Because 10 years ago, it's not like somebody was wandering around the streets saying, “Please, God, somebody come up with a digital signage CMS.” There were all too many of them. 

Jackie Walker: Yeah, that's very true. So we partner a lot and typically, even from the beginning, when we started this program, we were using SDL Tridion, which was a pretty well-established, web, and mobile CMS at that time. That was really the content foundation of what we were building.

We didn't want to build a “CMS” to use that kind of terminology, because most of our clients if you think about it, are operating enterprise CMS solutions, and so part of the “what if?” was, this novel idea that a customer could change their content in one place and that content change would immediately publish on their website, their mobile app, their digital signage, which is a little bit of a different frame of the problem, I think. 

Yeah. Certainly, you know you're joking about omnichannel and learning how to spell it, the whole premise has been around for a very long time, but I've noticed in the last two or three years, it's really come to fruition and you seem to get a lot of pushback from larger companies, potential clients essentially say, “I don't want to have 4-5 different platforms to do my messaging, I want to do it off of one thing and it should go everywhere. I don't want to have this walled garden for digital signage and another walled garden for mobile, communications, and so on.”

Was that the thinking? 

Jackie Walker: A hundred percent, and again, back then, like omnichannel, was a word on a PowerPoint, right? We had these cute diagrams that contained phrases like “all your enterprise services and you're going to have this API layer”, and everybody had to learn how to spell, right? And then all of a sudden magically all these consumer channels are just consuming data consistently through these APIs and it's all gonna work. That was really, I think the North star of that vision, but it's taken a little while for clients to actually get to that level of sophistication and that's been one of the things we've been watching closely is that progression where this dream of having these fully API enabled enterprises is now getting to a point where that is the expectation, right? 

Clients have all their infrastructure in the cloud, they're using common systems. They're starting to do consolidation across content, and now they're starting to do consolidation of data. And to me, that's the other key piece of the puzzle, it’s not just thinking about the content and the customer experience and the POS or the product inventory systems or their content management system, but then also thinking about how their customers interact with all of that data, all of that experience, and making sure that data is able to be used consistently across channels. So no content silos, no data silos. 

And when you started down this path 10 years ago, shared data was not easy. You could have these conversations, but they would say, integrating with our data set and all that is a quarter-million-dollar job, or it's just not possible, or you can't see it where it's not secure or we're worried about it being secure and on, there were all these problems. Now, data's pretty easy to get out, right?

Jackie Walker: That's right, yeah. It's definitely gotten much easier and just the flexibility has improved greatly as well. I think clients are used to it as well. You know, you're going to have an interface that you're exposing and then all of your channels that you're deploying are pulling from that content.

So I think, yeah, there's been a huge transformation there, which has been a big enabler. 

Do you have to, when you're working with clients, explain that integrating data is more than just being able to pull a number from one directory or folder or whatever it may be and make it show up on a screen and make it show up on another device, that there's more to it than that? 

Jackie Walker: Yeah. So I think that's the thing that's really interesting about digital signage, and I had the benefit of building websites and building mobile apps before we started on digital signage, so I had that digital experience frame of reference, right? This is how it works, this is how you're going to build a web page that's going to be pulling content from 10 or 11 different data sources, stitching that together and you understand how that works. And then you look at digital signage and it's a little bit of a novel problem, right? Because there are some differences with digital signage. Like the analogy I use is, if you build a mobile app, you're going to build one piece of software, you're going to deploy it on a cloud infrastructure, back then it was a physical infrastructure. You deploy it on infrastructure, your problem as the enterprise, like the client-side is worrying that you're hopefully releasing defect-free software and your infrastructure, your cloud is stable, right? You don't have to worry about Tom, Dick and Harry's mobile phone. Do they have connectivity? Is their phone charged? Like all this stuff, right? That's not your problem and the customer understands that. 

With digital signage, every little digital sign you put out in the world is your baby and now you're responsible for making sure that it has power, it has the internet, it has content, no matter what happens, it has content, and so there was a little bit of reframing that we had to overcome to be able to make sure that we were solving that problem comprehensively. And those differences really ended up being what guided the product development for premise and the digital signage solution was this idea that we were thinking about bridging that gap between an API enabled customer ecosystem and deployed digital signage at scale. So we were trying to fill that hole between the two. 

Yeah, there's been any number of very large companies that have decided, we're going to write a digital signage module or we're going to branch into this. And they get a basic platform working where files are playing one after another, maybe not even with a black gap in between them or whatever, and they're rubbing their hands together and saying, “Hey, we've done it!” 

There are a lot of problems that can develop, as you've said, and I suspect you guys discovered over time that once you have all these deployed devices in all kinds of different environments, all kinds of hell can break loose. 

Jackie Walker: Yeah, absolutely and I think that's an important differentiation too. I think there are so many signage solutions that were born out of looping media, right? And so the conversation is how do I build the best playlist? And there might be interruptions, there might be things that go into that but by and large, you're thinking about full-screen video, how many video segments of the screen can I have, maybe I'll have an RSS ticker, like you're thinking about slicing and dicing the screen, but your primary content is video content.

And I think for us, we've always been approaching this thinking about modularized data-driven content. So even if you think about what we are doing in the airports, we weren't just thinking about a video playlist, we were thinking about what's the list of restaurants that's going to show up. What's the list of restaurants that are going to show up that might be different if I know that there's a flight delay next to that gate, and so all of that is query-based data. 

Back in the day, our first clients were using Flex for the interface. Obviously now everything is HTML5, but it's all modularized content and so I think it's a different way of looking at the content problem as well. Are you thinking about big  full-screen content? Which again, then you're thinking about how you manage a playlist and make sure that your large video files get moved down to the device without getting corrupted, all that kind of stuff.

Whereas if you're thinking about this HTML5 content, it's just a little bit of a different frame of reference in terms of what you have to be able to do, the different pieces that come together to enable that, and then the analytics as well, right? Like how are you getting a level of analytics that is again, akin to what customers are used to from web and mobile channels. 

So tell me what Premise is, and if I'm a cranky CMO or CEO in a meeting with your team, and I say, “why do I need this versus brand X digital signage CMS that I'm already using?”  

Jackie Walker: Yeah, I've had many experiences where I've worked with customers who have already gone through a digital signage selection process, they've already picked their partner. And they say, “Okay, we are working with X platform and now we want to deliver an experience on top of that platform, what can we do?” And the problem is typically that they didn't ask the right questions about the software capabilities when they were doing the platform selection and then when it comes to the time to actually think about the experience, now they're designing backward from the platform capabilities, as opposed to designing forward from the customer experience, which is the position you always want to be in. So I think when I think about what Premise and how it's different, it's really thinking about in-venue experience enablement. 

We say in-venue because we might mean a QSR, we might mean a retail store, we might mean a hotel. So any physical place, we're really focusing on the real-time analytics and AB testing capabilities, and we're focusing on integrations and that is really at the forefront. So if I'm working with a QSR, the starting point is going to be the point of sale, it's going to be their product database, it's going to be their product photography. We're going to want to know as much as possible about their data models and so that we are thinking about it from what can we reuse, what do we tack onto, what are the places where we can create leverage points from what they already have, and then we're filling in the gaps, to be able to support the additional needs for digital signage that are maybe slightly different than what their needs are for web or mobile. 

I might not have big video assets for the web, or certainly for mobile. I might want to use different types of product photography, I might need some different ways of thinking about that. So that's really the approach for us and I think a lot of our clients understand it because they've dabbled and what they've seen with other solutions is that they're not able to get the level of integration that they're expecting.

So they'll go through the initial conversations, the technical design and think we're going to integrate with our CMS. And I think, when you say those words, they can mean different things to the vendor and the client, right? The vendor might mean I'm going to pull a data dump every seven days and the client thinks, if it's integrated to my CMS, I'm going to make a change in my CMS and it's going to publish, and so I think a lot of clients are now starting to get to that level of sophistication and understanding where they're realizing that there is a little bit of a gap between what the current capabilities are in the market and what they want to deliver.

I had a conversation with someone in the hospitality business that manages a bunch of properties. They do a lot of merchandising of their onsite restaurants, their shows, all that. You can think like a Vegas casino type, that frame of mind, so they have all kinds of stuff that they're trying to sell customers and all of it is manual. So if they need to change the priority of a piece of content, there's a huge manual effort to go in and update their playlist on all of their screens. So we talked with them about what would it look like to build an AI engine on top of that? 

It could look at occupancy in restaurants. It could look at ticket sales, yield projected versus what they've actually sold. So it could prioritize what are the things that I merchandise to my customers that are meaningful. I don't want to merchandise a restaurant that's sold out, that doesn't help me, it doesn't help the customer. 

And what we found is that the level of metadata to be able to fuel an AI engine to be able to start to do some of that, even on a rules basis, just didn't exist in the digital signage solution they were using. Even at that level, when you start to want to deploy AI and start to get more sophisticated about the ways that you're deciding what content goes on the screens, I think the current vendor set, the current solution set in digital signage is somewhat lacking and that's really why we're in the business and we're pursuing it so aggressively is that we keep hearing more and more of our clients talk about this unmet need.

And is that a function in a lot of cases of them being in there refresh cycle where they're there four years in with a particular vendor realizing they like the notion of this, they like the outcomes of screens and so on, but they need to do more, and they're now realizing their initial platform that they went with just doesn't cut the mustard, so to speak? 

Jackie Walker: Yeah, it's a mix of both, some of our clients are in refresh cycles, some of our clients have just done pilots and they're realizing that maybe what they thought they were going to get out of it isn't really coming to fruition and then some of our clients are starting to look at this for the first time, right? They're recognizing, especially QSRs at the drive-thrus, that's a huge area of focus for us right now, because of COVID obviously you look at the market in the US, like 80% of QSR still have paper at the drive-thru. Now 90% of their business is going through the drive-thru. So there's this huge gap between the capabilities that they're able to deliver.

How are they going to meet customer expectations and the solutions that they have available? And we're really saying if you're going to do it for the first time, don't think about what you want to do tomorrow, because maybe you just want a JPEG of your menu tomorrow, but once you make that huge CapEx investment, especially outdoors, be smart about what you're going to do there because in the next five or seven years, you're going to be wanting to do a lot more, probably. You're co-investing in data initiatives, in loyalty programs, how do you connect the dots? That's always my big call to clients, is to think about what's the customer experience roadmap? And being a little bit aggressive so that you're not making a mistake on the hardware you're deploying, or even if you're buying an all-in-one solution that you're working with a partner that's not going to be able to grow with you.

This sounds much more like an engagement, a project, as opposed to “All right, I'll buy my software. I'll use Publicis Sapient’s Premise, and you know, Bob's your uncle, that's it. You may get some support.” 

It sounds like you guys want to be in the weeds with the client, from the ideation stage, all the way through to execution, right?

Jackie Walker: Yeah, you're hitting the nail on the head. So the play for us is not the digital signage licenses, so to speak. That's not the piece that we're interested in. It's not a set it and forget it solution. I think there's a well-established part of the market that does that really well, like grab it and go.

What we're really trying to do is work with customers who are looking for more involved customer experiences that are really trying to use this channel to make an impact on their business, that recognizes the value of analytics and AB testing, and that are thinking about how do they pave the path to driving differentiated customer experiences over time? And so there's a little bit of consulting, there are a few creative services, there's a ton of technology, all that kind of comes together when we're engaging with a client. 

I'm going to assume that your preferred client or the clients that you end up getting are those who have a history with agency services and work already, because they know how you guys roll and how things happen versus somebody who maybe started out with brand X digital signage CMS and has never really worked with an agency other than maybe producing some creative for them and all of a sudden there's a full-tilt engagement, which is, you still got a few zeros attached to it and there's a lot more involved.

Jackie Walker: Yeah, I think that's right, and it could be either, It could either be the marketing services side or it could be the systems integration side. So we definitely have had a lot of success in using the solution with existing clients where we already have a technology footprint with them and then it becomes about how do you leverage what you're doing in one part of the business on this additional channel? I think that's a huge part of the value proposition. 

Yeah, and certainly a macro trend within digital signage is this idea of one throat to choke or turnkey solutions, I don't want four vendors, all pointing fingers at each other when there's an issue. 

Jackie Walker: Yeah, absolutely, and I think that can be a little bit of a double-edged sword, right? Sometimes I think about what happens, and I've seen this with a number of clients where they treat digital signage as a siloed point solution.

“I'm going to buy digital signage,” and even the terminology, like a digital menu board is a great example, it sounds like you're buying a physical thing. 

“I'm Bill, I'm buying an object.” 

Honestly, that's a lot of how it's sold by a lot of companies, which I think is goofy, but nonetheless, they saw it as SKU, as a thing.

Jackie Walker: Yep, absolutely, and I think what is becoming accepted is this idea that digital signage is a digital channel. It is like your website. It is like your mobile app. It is a digital touchpoint for a customer, and I think we, as an industry, haven't done enough to push the capabilities and the thinking around the types of experiences that clients can deliver. It's been allowed to function as this kind of siloed thing on the side. So you have, even in an organization, the people who are buying digital signage are often not the same organization that's managing the rest of their digital customer channels, which is also a little bit mind-boggling sometimes.

So that's another piece that I always try to encourage customers to think about. This is not a, not just a marketing problem, it's not just an IT problem, and it's certainly not just a store-ops problem. It's actually an intersection of all three and you need to make sure that you're bringing all three of those organizations along for the ride, to make sure that you're going to end up with a solution that actually works and delivers value to the business.

Yeah, years ago I had a very large multinational brand consulting client that was putting signage solutions into their stores and the department I was working with was relationship marketing and they referred to themselves as the land of misfit toys. 

It was just like skunkworks, they caught all the stuff that nobody else wanted to do. It makes me curious because I've seen this with other very large companies where they have created digital signage business units or effort, and it's functioned largely as a skunkworks and you can tell it's a skunkworks, and sometimes the people who are running it are people who put them there to get them the hell out of important meetings or whatever.

(Laughter)

I’m not saying that in the slightest with what you're doing.

Jackie Walker: I’m glad I gave you that impression. 

Not in the slightest. You know your stuff, you've been doing this a long time, so in the larger context of Publicis Sapient, how much of an effort and how much visibility does this have in terms of the overall company? I know it's hard to give a percentage, but... 

Jackie Walker: That's a great question. I think there was a period where it was a little bit of a side business, so to speak. We were doing things like this airport managed services platform for wayfinding. We had a bunch of different clients. It ended up extending to like retail casinos, we had a sports stadium that was using our wayfinding platform, but it was a little bit of this thing that was allowed to continue to progress, and then, I think what has happened in the last couple of years, as we've shifted our focus to digital business transformation, and I actually remember really well a conversation I had with my boss, like when we started internal communications around that change and frame. 

I said, I'm really excited about what this will mean for the work that we're doing with the Premise because it's so tightly aligned to our strategy as a business, and he looked at me and I said, if you think about it, so many of our clients do so much of their business through their physical footprint when you think about retail, when you think about QSR, it's insane for us to not have an offering that directly addresses the opportunity, to drive business impact in their physical venues, right? And the reality is, if you look at the solutions that are available, it's not a place where we're going to be able to readily partner with existing companies, existing CMS, digital signage solutions, to be able to deliver those types of outcomes. So for us, we actually think about it as the market is moving in this direction.

We had a ten-year plus headstart, I think. A lot of people in the industry will say that the future of digital signage is probably going to be driven by software, and I think we're in a really great position to springboard that for ourselves and realize outcomes for our clients, in an accelerated manner because of this asset with Premise.

Yeah, there are not many good things to say about COVID, but it has forced an accelerated digital transformation plans of a whole bunch of companies, retail, QSR, and beyond, from something that we're going to do in three to five years to something they had to do in the next three to five months to survive, and I gather you've benefited from that. 

Jackie Walker: Definitely. I think it's just been this, at Publicis Sapient level, it's really validated our strategy. I am a little bit of a Kool-Aid drinker, like I really believe in the work that we do, that's why I've stuck around so long personally.

And that's also why I haven't made the choice to go to a more traditional digital signage company. I think that the unique perspective that we bring to the table because of the scope of work that we do for our customers every day, the focus on omnichannel, the focus on customer data, the focus on AI, the focus on marketing efficacy and performance marketing, we just have a completely different perspective and a completely different group of people and experts that we can bring into engagements to deliver outcomes that would be just absolutely impossible otherwise. 

Now the last time I went to the National Retail Federation Show, there must have been at least 20 booths, maybe a lot more companies, all showing retail analytics, shopper analytics, computer vision-based stuff, sensor-based stuff. 

You're talking to a lot of retailers, you're talking to a lot of large corporations. Do they see this as being as important as the vendors seem to think it is?

Jackie Walker: That's a great question. I personally get frustrated with all these point solutions because I think they do end up being just that. 

It's like queue management, so we're going to instrument the environment, we're going to understand the queues and then that's going to help us optimize customer service, or we're going to now measure everyone's temperature when they come in and that kind of theater around it is going to make people feel safer and better, and so there are all these little solutions that pop up that isn’t well integrated. It doesn't all come together particularly well, right? Beacons, one of my favorite examples, we talk so much about Beacons and it's like the mobile beacon and what are we going to do? And the push notifications, and now there's a ton of movement around geo-fencing and QSRs too, you know, to hook into kitchen operations, but they're really the same technologies that could be, if done right, enabling a ton of different types of capabilities of customer interactions, of different ways of driving value for the business on the customer, but instead, they're thought about as these little things, dot one kind of additions, that doesn't particularly connect. 

So I think that's a hard pill to swallow. They each has their own, it's a different SaaS model. You have a SaaS subscription for this, you have a SaaS subscription for that, so I think that's a big challenge. So that's something I try to think about when I'm working with customers, what are the existing initiatives they have? What are the existing capabilities they have and how do you stitch them together in meaningful ways so that you're maximizing their current investment, but also thinking about how you connect the dots moving forward. 

I think QSR has some great opportunities ahead of it, with regard to different service methods. So now they're pushing so many customers to mobile order and pay, which is fantastic, but they're going through the drive-through still, like how do you deal with these customers? Because if you're showing them the same menu board that you're showing somebody who's. trying to order, you just wasted an impression, so to speak, with that customer, right? You could have told them something new and different. You might have totally different messaging for them because you know them, or even if you don't know them, they already ordered, right? Or if it’s a delivery driver, you know that it's a delivery driver. You could know that. So how do you start to think about the intersections of these different service models and different technologies to create better customer experiences? 

You mentioned customers. Are there any customers you're actually allowed to reference and say, yeah, we work with these guys? 

Jackie Walker: Not today, Dave, you know how that goes. (Laughter)

Oh yeah, the big agencies and big clients, you don't mess with those accounts and upset them in any way, but we can think of Fortune 100, Fortune 500 kinds of companies? 

Jackie Walker: That's really the target group and the group that we work with the most. Yes, absolutely.

All right. this was terrific. We could have chatted for a lot longer. It was very nice to virtually meet you and hopefully, we meet each other in person someday. 

Jackie Walker: Absolutely, when there’s offices again, right? (Laughter) 

All right. I really appreciate you giving me some of your time. 

Jackie Walker: Absolutely. Thanks so much, Dave, take care.

Kym Frank, Geopath

Kym Frank, Geopath

December 2, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

Measurement in the out of home advertising industry used to be as low tech as people with clickers, parked on roadsides and busily counting the cars going by.

That would give media companies a really basic sense of how many eyeballs MIGHT see a billboard in a given time period.

The out of home industry has long since matured, and a lot of it is now digital ... and much more varied than billboards and transit shelter posters. Measurement has also matured in a big way, and has grown super-sophisticated.

Out of home media is very much a for-profit business, but a key player on the tech measurement side is actually a non-profit ... supported by hundreds of companies in the ecosystem.

Geopath is populated by data scientists and site auditors who do audience location measurement based on a pile of different data sources - the biggest one being aggregated, anonymous data from smartphones.

Geopath's tools, which are used by media owners and brands, help build a current view on the mobility, behaviour and attributes of out of home audiences.

A lot of this stuff is way the hell over my head, but thankfully Geopath's President Kym Frank is very good, and patient, at explaining things to knuckleheads like me.

TRANSCRIPT

So, Kym, for those people who don't know much about Geopath, can you explain what it is and how does it work? 

Kym Frank: Sure. So Geopath is a really unique organization. We've been around since the 1930s, we were formed as a joint initiative between the OAAA, which is the Industry Association for out-of-home advertising, the ANA, which is the Association of National Advertisers and the 4A's, which is the Association for Agencies.

So we have existed since the 1930s with the sole objective of measuring out-of-home, digital out-of-home, and all its formats advertising. We're a nonprofit and we are still to this day, governed collectively by agencies, advertisers, and the media owners themselves. 

So being a nonprofit, I assume you're funded by your members.

Kym Frank: We are. So each of our members pays dues to our organization that supports the development of our measurement system and the maintenance of our measurement system itself. So it's a really great setup, because everybody just pays a fraction of the cost to develop these metrics and then they are able to be, universally used by the entire buying community, across all the different formats that we measure. 

So who would be typical members? 

Kym Frank: So we have a lot of out-of-home members from the big operators, like Clear Channel, Lamar and Outfront, all the way down the line to some small members who have three or four billboards, maybe.

We also have agency members, so big holding company agencies down to independent local specialists. And then we also have some advertiser members as well. In fact, our executive committee has representation from Coca-Cola and representation from Constellation brands, which is the brand that owns the Corona brand, and so we have grown quite a bit. In 2015, when I joined, we had 180 member companies and as of today, we're at approximately 390 members. 

Nice. You've doubled it and then some. I'm sure you tell the board about it, right? 

Kym Frank: I do all the time. 

Is there a for-profit competitor, like a company out there that has data that you would pay for and measurement that you would pay for?

Kym Frank: Sure, so we don't say we have competitors. We say we have “friend predators”. 

Geopath provides currency level measurement, and I would say we probably measure 95% of the industry, but there are other kinds of measurements that are out there. People might want to understand how their campaign performed in terms of conversions, so did our mall ads drive people to make a purchase? So there are a lot of other companies out there that are doing that kind of measurement for sure. 

So that’s more on the analytics side, right? 

Kym Frank: Absolutely, so more custom solutions, things along those lines. There's a lot of technology out there that measures things in different ways, like I know you and I have spoken about facial detection technology, and people who are connecting to the individual devices, so there's a lot of different methodologies out there. 

This will seem like a really obvious question, but I'm going to ask it anyways, cause I'm not very bright. Why do media companies need measurement? 

Kym Frank: That is a good question. So advertisers across channels, this is not an out-of-home problem. Advertisers across channels want to understand, what did my campaign deliver or, on the front end, what should I be buying with my advertising dollars? And how much of it should I be buying? So that they can understand the scale of a campaign that they're purchasing, are they reaching the right people? Are they reaching enough people? How many times are those people being reached by my ads? It's really important to advertisers. 

In the old days on, by old, I mean like 10-20 years ago, even that’s recent, a lot of out-of-home was just measured by gross audience counts, right? Like highway traffic or foot traffic meters, that sort of thing? 

Kym Frank: Yeah. So when I joined the organization, the legacy metrics, a lot of that was coming from rubber hoses in the road, like the department of transportation, traffic counts. So nowadays we're able to use things like connected car data and mobile device data, but that was not available.

So yes, they were using manual counts. In fact, if you go way back in time, we used clickers, so people would stand under a billboard with a clicker in their hand and count the number of cars that went by in an hour. 

Yeah. And the same thing in shopping malls, there'd be somebody there with a clipboard just clicking away?

Kym Frank: Yep. 

Amazing. So is good audience measurement something that just validates making immediate investment, or is used to also optimize the investment that you're making, that you've already decided? Like, I'm going to be in this market, I'm going to do these things, but I want to know a hell of a lot more about the audience and then tune the media and tune the campaign so I get more out of it. 

Kym Frank: Absolutely. Optimization is key and it's a lot of what we've been working on since I joined the organization. When I joined, we had the ability to target pretty standard demographics. So I'm interested in reaching women 18 to 34, but since we've updated our measurement system, we now include information across 8,000 different audience types. So you're able to understand which units I should be advertising on. If I want to build a campaign to reach people who are likely to be buying a new car within the next 12 months, it's really changed the way out-of-home is bought more from more as an audience channel than as a patient vehicle.

Now, both are still very important because you want to reach people in the right location, but you also want to make sure you're reaching the right people. 

And where does the data come from? You mentioned geolocation data from mobile phones, but there's a whole mashup of things you use, right?

Kym Frank: We, so we have a data fusion engine is what we call it. We take a number of different kinds of data sets, there's just no silver bullet that does everything, so we combine a number of different data sets for what they are best at. So we are using mobile device data, that's typically data that's captured by apps that people have opted in to have their location tracked on their phones. That's all anonymized and aggregated, so we're not ever following around one unique device or anything along those lines. We get data from connected cars. We have data from Maps, we still do validate against some traffic information and real-time data that's available from other sources.

We're partnered with Claritas, that's survey data for some audience targeting. It's a huge data stack and a lot of modeling that goes on to develop the product that we provide to our members 

Are things like census data also important? 

Kym Frank: Absolutely. In fact, I know that the census has been very troubled, due to COVID. 

And a guy at 1600 Pennsylvania.

Kym Frank: I didn't say that. But yeah, the census has been very challenging, but it's very important, not just for Geopath, but it is something that is utilized across pretty much everyone who does any kind of survey at that population level. So really very important. 

Yeah. I think you've said in the past that the best data that you get, if you had to look at all the different elements, is the mobile data, right?

Kym Frank: Correct. That is the biggest piece of what we built. 

If I have a media network, an out-of-home media network of some kind, and I don't know, let's say I'm in hospital waiting rooms or whatever, if I don't have some degree of measurement, if I've not part of Geopath, If I don't have that kind of data available, will a media planner even look at my network? 

Kym Frank: I think so. I mean, it certainly helps to have data attached to it and it has to be data that the buyer feels comfortable with, but there are certainly strategies that would involve using a network that maybe does not have a level of currency.

The fact that when you're talking about a network along those lines, while they may not have impression and data or reach and frequency data, usually everyone has some kind of first party data. You may know if you're a hospital network, how many patients you have, you may know if you're at a gas station, how many receipts are generated.

So there's always some kind of data available, but certainly currency data and impressions data or reach and frequency data, that's what a buyer's really looking for. 

Yeah. You've mentioned currency data a few times now. Could you explain what that is? Cause I'll be honest, I'm not totally certain what you mean by that.

Kym Frank: So when we say we measure currency, it's really because those are the impressions that are being bought and sold for the channel. Every channel has its own kind of currency. So a lot of it's measured by Nielsen, which you may be familiar with here in the United States measures television, and so then we provide that currency for out-of-home.

And is there a challenge with there being different currencies and having some sort of a common currency? 

Kym Frank: And that's exactly why Geopath was created, it was to provide a common currency across all of the different formats of out-of-home. So prior to the generation of this organization, every different operator had their own sets of numbers and it was impossible for a buyer to put them together. Because we have built such a large database of all of these different operators' inventory, it makes it really much easier for a buyer to go in and say, okay, I bought inventory across 30 different operators, but I know what it delivered collectively because the currency is very common and that's really come a long way, because as we've recently announced, we launched in-venue measurement. So prior to this past year, Geopath was not measuring things like airports and malls and bars and restaurants, but we were able to stand that up and we look forward to our buyers really being able to buy a package of roadside inventory and combine the data with in-malls or in-bars or in-airports and get a comprehensive number.

Yeah. Those are two very different dynamics when you're talking about highway billboards or spectaculars in big cities and then talking about screens and bars and all that, like that must've been quite an exercise to figure out how you equate all these different kinds of mediums in one platform.

Kym Frank: Right and every network is very different, yeah. We have partners who have jukeboxes in bars and then we have partners who have very large screens inside of transit hubs and measuring each one of those is very different. We measure every screen, every spot we audit them all. It's pretty complicated, it's the only thing we do, it's our priority So we want to make sure we're doing it right. 

So when you say it's the only thing you do, it’s like you have a bunch of data scientists working for you? 

Kym Frank: I sure do. 

Those are expensive.

Kym Frank: I have a team of auditors. We really do have two products, right? We audit the inventory, so we have to make sure it's where they say it is, that the signs are the size that's been reported. We measure the angle, the oncoming traffic, whether that's foot traffic or oncoming car traffic, we measure all of the different places where a sign can be seen from, so that's really step number one, so I have a team of auditors also who spend a lot of time looking at inventory and just making sure that it's in the right place.

So we have an audited inventory database that has millions of locations across the country in it and then we measure those units, and that's really the data scientists. 

So if you weren't doing an audit, what's your read on how accurate network representation would be? 

Kym Frank: It really depends on the network. So we just really did a whole re-audit of everything we measure on roadside and back in the day when people would report, which direction their units were facing. For instance, if you think about a billboard on the side of a highway and the highway is, let's say it's 80 East and the unit was on the westbound side, they might say it was a westbound facing unit. But now when we go in, we actually can go into satellite imagery and look at that unit and say, it's not actually perpendicular to the roadway. It's not actually facing that one direction and getting it to the exact degree. And the reason that's important is if you're approaching a unit on a highway, we want to know at what point in time, can you see that unit so that we can accurately measure how many impressions it's delivering. 

Yeah. I'm up in Canada in Nova Scotia, which is just all forests, it’s like Maine or New Hampshire or whatever. And, when we go down to see our daughter, she lives about 40 minutes south of us, and there's a Wendy's billboard that I've seen for the last two or three years and wondered if they're selling this to Wendy's because you can just see the top of it. Because all the trees have grown up at a level and I'm sure if they were looking at that and wondering, why am I paying for this? Because nobody can see this unless they just recognize the colors and go, okay, that's a Wendy's billboard back there somewhere.

Kym Frank: Yeah, we really do take into account exactly how long oncoming traffic and, it gets even more important, Dave is when there's a digital unit that is showing multiple ads. So how many of those ads can someone see as they're approaching the unit becomes a really important part of our measurement system.

So with the audits that you do in the height of a pandemic, how do you do that? Is it all of using satellites, and asking people in local areas to go onsite and take photos? 

Kym Frank: So we do use photo sheets from our members, almost always have photos of their inventory, cause they share them with advertisers after a campaign.

So we take those photos, but then we do use satellite imagery, and there's some really great information in Google maps. Now we can actually pretend we're in a car within Google maps and drive down the road and go, at this point in time, this is when you can start to see that unit, and once the car passes this location, you can no longer see it. So we've been really empowered by Bing and Google, developing these great map technologies. 

We've been on a number of round tables over the last few months for different things. And you've spoken a number of times about how things have been going through COVID-19 and how you measure movement of people and activity in general. And there was certainly a dip, but it seems to me the last time we were talking and from stuff I was looking at, it's come back to really pre-COVID levels of activity. 

Kym Frank: Correct. So when we're talking about the number of people who are leaving their houses on a daily basis, 75 to 76% of people are going out on any given day. Usually that would be closer to the low eighties, so there is a little bit of a depth, and then the miles that people are traveling nationally, we are at 92%, I believe this week versus the week prior to COVID impacting traffic in March. So there's a little bit of a way to go. 

What I think is really interesting about the data is it's a very significant market-by-market and it varies depending upon where a market you are looking at. New York was obviously very severely impacted, but there's places in the country where traffic is actually higher now than it would have been in March. 

And it has that kind of measurement being important for both the media owners and the brands to understand that, yes, you may have this sense that we're in lockdown and nobody's going out or anything else, but here's the data that says otherwise? 

Kym Frank: A hundred percent. So one of the reasons we put the data out and we really thought it was going to be a very temporary situation back in March. 

One of the reasons we put it out was people were saying things like there's no one on the road and we knew that was completely not true. There were people on the road. In fact, there were quite a number of people that were out on the road. So we try to avoid that focus group of one phenomenon where people go, “I was driving yesterday and there seemed to be less cars.” So we put those data out and it's funny cause I was having a conversation with my counterpart at a radio company who said that he's using the Geopath data to combat the same kind of conversations that he was having with advertisers and brands who were saying, “There's nobody on the road, so no one's listening to the radio,” and he said, we go in with the Geopath data and we say, “No, look, there really are people on the road,” so it's been a huge benefit for our channel to have access to those data in near real time.

And I really do have to be thankful to so many people who helped us get that solution up off the ground super fast. We had an entire committee of some of the smartest people in the industry working alongside us. as things were getting really pretty ugly in the country, back in the springtime, who really helped collectively stand up something that was very reliable, very stable, and very fast.

The industry as a whole, you've got a lot of brands, particularly retail brands who have been really struggling and other ones that have done well through all of this, have you seen a shift in buying an investment in media at all? Or is it just sluggish like most things are sluggish these days?

Kym Frank: Yeah, I think every channel has been impacted. Advertisers are more cautious with their dollars right now, so we certainly felt impacted, as a channel, but things are starting to look up for us and I think the same as is true, whether you're looking at television or radio or print, we're all just coming out of this depth now, and then looking forward to next year, we've got some pretty good projections. It looks like out-of-home will bounce back. So I'm really excited about that. 

I still get emails and phone calls from startup companies all the time who want to do or are planning to do, or in an early throws of doing a place-based network in some sort of defined venue, whether it's groceries or I don't know, ski resorts, I'm making stuff up at this point, but, are there pieces of advice that you provide and also, do you have insights on what of those startup networks have a better shot than others?

Kym Frank: So we always suggest, and we're happy to give some advice to folks if they want to give us a ring before they put the screens up and before they put the signage up, to just understand what are the best places, locations, angles to optimize reaching people prior to making the investment. Like we have a lot of information on duration of ads and duration of content and how to optimize that kind of stuff from a mathematical perspective before you make an investment in putting up inventory. 

We can get access to that information because we're measuring so much already. So one of the things we're working on right now is curating norms so that we can understand if you're going to put inventory up in a bar or a restaurant, what kind of impressions can you expect to deliver? So that people can really figure out, okay, before I put the investment down, is this going to be worth it? Am I putting the screens in the right places? Am I running the right kind of ad durations and ad spots? 

I think also to reach out to people who own that kind of inventory and talk to them and ask, “how is your network performing?” before they go in, so I think the out-of-home industry really is a pretty unified industry where everybody recognizes that we can't compete with each other. We need to compete for ad dollars but when we compete with each other, we just don't do as well. So it's an industry where there's lot of people who are very generous with their time and very willing to help.

Yeah and I think that's important because I run into so many early stage business models where it's just all about the venue, and this idea that (let’s say Bars) there's so many liquor brands out there and there's all these craft ones and so on, so there's so much money available for advertising, and then they start this thing up and realize, “oh my God, advertising is actually pretty hard.”

Kym Frank: Right. At the end, making the choice between being a local network versus a national network or somewhere in between, is also something to really think about. 

Are you going to be selling every screen you own to the same advertiser, or are you going to be splitting that up and selling it regionally or locally? Because that has an impact on how you staff your sales team for instance, and how you structure your network.

Yeah. Going back to a mobile location data and the whole fuss about privacy. There was another instance up here in Canada, a couple of weeks ago. The Canada's privacy commissioner went after a big shopping mall operator saying, “You were invading consumer privacy by using anonymous video analytics,” and I went off on that because it said right in their own report that it was anonymous so what was the big deal? 

When it comes to mobile location data, have you had to tread carefully around using that and how you present it, or do people just take it as a matter of course? 

Kym Frank: Yeah. So there's two things in that question, right? There's the “what are you doing and are you doing it responsibly?” And then there's the “are you speaking about it responsibly?” 

And I know I sound like a total broken record about that because I get concerned when people say they're doing things to sound super sophisticated and tech savvy, and then they get you in trouble because you're talking about what you're doing in a way that's just not responsible. So when we built our system, we built it in such a way that it was as responsible as humanly possible so much so that we probably went to the extreme because it's so important that our currency not step over line. 

We built it deliberately to not cross over any lines, but then when we speak about it, it's again like a broken record, you’ll almost always hear me say, it's aggregated and anonymized. In fact, I think the vast bulk of our members probably say it’s aggregated and anonymized multiple times per day, because it's now been so drilled into us that we are in the public space and we want to make sure that people know we're not doing anything that people should be concerned about.

Is it a case where you see less of a focus from consumers because they've already made that bargain, so to speak, if they're going to use Uber or something else that absolutely requires location for it to work effectively that, “Okay, we've signed off on that. We're okay with that,” versus camera's on and the out-of-home display and they're saying, we didn't sign off on that, so that's terrible but the anonymized data that comes off of a phone, we're okay with that. 

Kym Frank: Yeah. Online has been doing it for so long and people are so used to it. 

“I was shopping for shoes and then the pair of shoes I looked at has now been following me around my browser for a week.” 

I think people just accept that's the case. The camera thing, I know you and I've had this conversation a multitude of times. We do not really use any kind of camera technology. If we have a member who has cameras installed, we will take their data as a calibration point, but we don't actively use that ourselves, but it just makes me laugh that people get upset by facial detection technology, because everybody had VHS tapes with cameras running in every location across America and no one ever really got upset about it, but suddenly there's a technology that actually makes it more responsible because you're not recording people as they're shopping and for some reason that makes people upset. 

Do you not use the computer vision stuff more so because it's an analytical tool as opposed to an audience measurement tool?

Kym Frank: For us, it's just not scalable. We measure millions of locations across the country, and some of those locations don't even have electricity running to them, and some of those locations, that's not allowed and it's just not a scalable technology if you're measuring millions of locations. 

Are there mountains, so to speak that you're still trying to climb in terms of amassing more data and developing even deeper insights? 

Kym Frank: Certainly. The conversation about recency, so how recent do the data need to be, and at what cadence does it need to be reported? So those are conversations that are more business implications than data implications, that we're having with our membership, because out-of-home is typically still bought in four-week cycles, so do we need daily data?

And a lot of this has gotten escalated by the increasing footprint of programmatic buying that's happening in our channel. So it's pushing us forward, certainly COVID has pushed us forward from an evolutionary standpoint on data, because everybody wants to know what's going on with COVID last week, not three months ago. So that is certainly on the forefront for us. And then, I think as a channel, less of a Geopath issue, but more of a channel is demonstrating the true value that out-of-home can bring to an advertiser or a brand, how we can drive increases in purchase and how we can drive foot traffic?

And again, I say that's not a Geopath problem. We don't really do attribution or campaign effectiveness and to say it's an out-of-home problem is not true either. It's just a media problem because every channel needs to find ways to demonstrate its value and I think it's hard for everyone, how do you demonstrate that somebody listened to a radio ad and then made a purchase? So connecting those dots, it's a media challenge. 

Do you see a time when there'll be a demand to have real time data being used for out-of-home? 

Kym Frank: I think near real-time certainly. I don't know that we need to know what happened an hour ago, but certainly we would like to know as recently as possible. Right now, there's just data costs associated with processing that level of data so we have to make an assessment on the return on investment in investing in that level of data for everyone who's using the data. Is it worth it to invest in storing, processing and accessing that level of data? I don't think we're quite there yet. 

So last question, what should we be seeing out of Geopath in the next year? 

Kym Frank: So Geopath is in a pretty big R&D phase right now with our Insights committee, really trying to answer the questions that we were just discussing. So what levers do we need to pull for the next five years, to fuel the next five years of growth for out-of-home?

So we're having those conversations now, I think we're going to continue to grow our membership. We have a constant stream of new networks coming online. In-venue, we are doing doctor's offices now, we're doing grocery stores. So I think the other interesting thing that's happening right now is the question of what constitutes an out-of-home network?

So that line is very much blurring for us. We're seeing a lot of wrapped cars. We're seeing stuff that used to be shopper marketing type networks, now coming over to the out-of-home side. And then there's also what typically would have been considered television, but a television in a location like a bar or a restaurant and we're starting to measure those now too. 

So what constitutes out-of-home, is I think the big question. 

So is that media owners, for people who do things like shopper marketing and so on, following the money? 

Kym Frank: I think following the money, but also following the data. Because we have the ability to measure those networks, it's like the best of both worlds for them, right? Maybe they weren't being considered for an out-of-home buy in the past because they were shopper marketing, but now they can also put metrics behind what they're providing on the shopper marketing side. 

All right, Kym, thank you very much. That was great.

Kym Frank: Thank you so much. I'm really honored to be a part of this. 

Honored. Wow. 

Kym Frank: Yeah. 

You obviously lead a sheltered life. 

Kym Frank: Well, recently for sure. (Laughter)

Stephan Odörfer, 4tiitoo

Stephan Odörfer, 4tiitoo

November 25, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

While we all have learned, and mostly remembered, to wash or sanitize our hands after we touch surfaces, the ongoing pandemic has undoubtedly made a lot of people antsy about touching any surfaces unless they really, really need to.

Self-service screens are one of those surfaces that makes at least some people jumpy, and things like voice-based ordering or throwing screen controls to the customer's smartphone have come up as alternatives.

Now 4tiitoo, a German company that mainly does eye tracking for workplace environments, is touting a solution that would enable doing things like ordering a burger at a restaurant chain to be contactless.

A built-in sensor on the kiosk would track and respond to what a customer sees on the screen, all the way from a welcome message and through to order confirmation.

This is not stuff out of a sci-fi movie, but a riff on existing technology that takes endless mouse work out of repetitive office jobs and allows workers with greasy or occupied hands to navigate and update a screen just by looking at it.

Stephan Odörfer, one of the founders of 4tiitoo, walked me through the thinking, and how it all works.

Subscribe to this podcast: iTunes * Google Play * RSS

TRANSCRIPT

David: All right, Stephan, can you give me a rundown on what your company is all about and what your technology does broadly? 

Stephan Odorfer: Sure. So at 4tiitoo, what we're doing is all about natural interaction, using your gaze, first of all, but in some use cases also combining speech and gestures. So basically combined, I would say natural interactions that humans can do. So what we're mainly doing nowadays is we are controlling standard workplaces, from accounting to support centers to engineering, and largely replacing the 50 year mouse, so that means, while you're having your hands on the keyboard, you start typing and when you want to select a different input field, for example, in your SAP environment, you just look at this field, which you're doing anyway, and you continue typing because our software understands what you want to do and basically predicts the intention and proactively helps you in your daily tasks.

So this is what we are usually doing for several years. Now, what we have been doing lately is hands-free or completely touchless interaction in kiosk situations, or in dedicated restaurant situations where you use your gaze, as you do today, you browse through the menu, an automatic disc will roll a list while you're reading it and our system understands that you are currently in reading mode and obviously what do you want to do at the end of a page? You want to continue scrolling it? So the system automatically scrolls for your reading speed and what it also does is obviously if you want to select a salad or a burger, you just look at these items, and then we developed a special way to basically trigger these elements, because it's not about just looking at them and boom, it happens. That's not good. So it's rather a way to basically first select something and then trigger something just with your gaze.

So this is in a nutshell what we're doing. 

David: The restaurant applications for self-service ordering and so on, was that something that was already an ask from operators prior to COVID or is it because of the pandemic that this is now something that's being put together? 

Stephan Odorfer: It was clearly connected with the pandemic, the topic of people being afraid of touching surfaces or the need in restaurants to continuously make sure that these surfaces are clean. We have seen this in manufacturing environments. We have seen this for a long time already so we have productive solutions for people on the shop floor, having gloves, et.c.controlling their shop flow terminals just with their case, so that they can continue doing their actual job with their hands. 

Now going into the restaurant business, it's quite similar because it's a clear interface, you have a bunch of options that you can touch or click on and now basically look at, and it's not a complex interface. So what people are doing there usually is pretty similar and due to the COVID-19 situation, people were looking at solutions for not having to touch things, on the one hand, and what we could offer with this technology is not only replacing this need to touch something but it's also using our gaze technology, we also see what people are interested in and based on this information, we can predict what the user wants to have, in this case, what he's looking for and then in this case, can propose recommendations for based on his current view, his gaze history, not based on the history of other people, but on his very history. And, therefore we can not only make his experience more personal, more individual, but also create a potential for upselling and cross-selling, from the store.

David: So you're using machine learning or some kind of computer vision to do that? 

Stephan Odorfer: Yes. So it’s a local based technology because privacy is an important topic for us. So it's not being transmitted in the cloud, everything that we do here in this personalization runs on the local system and what it basically does, it understands where you're looking at and what you're not looking at, which is very important.

So this is an area where we have already filed several patents because one of the most important things is obviously at work is what you look at and how you look at things, but what is also very interesting is what you're not looking at, because in your peripheral view, our autopilot works. So, the autopilot in our brain basically works if I say two plus two, in our brains, it just makes sense. But if I say 42 times 17, there are not that many brains where the solution comes up. So we need to focus on that and do the math, but the automatic part in our brain that is basically getting, selecting what should be put in or focus. So in this area, when I'm scrolling, for example, let's say scrolling through a menu in a restaurant that has different pizzas. For example, what I'm doing is, I'm basically quickly running through a page and I'm scanning things like we do if we do a Google search, for example, what is reading each word and if it makes sense, if our autopilot says, “Hey, this could be an interesting result,” only then we put our focus on it and then we read it and then we decide, and we basically understand what you already get rid of in your autopilot, because this is very important to create a better funnel and to create better results in less time. 

David: Okay. So when the original, maybe not the original, but the most familiar gesture sensors out there, the Kinect sensors that came out maybe 10 years ago, there were attempts at that time to use gestures as an interactive interface for screens and the objection I always had and observed, was that there was a big learning curve for people to figure out how to use this, and I would imagine in something like a restaurant environment, where a lot of the goal is to speed up transactions, speed up decision-making and everything else, how do you get past something where you're walking up to a screen for the first time and it's an unfamiliar interface?

Stephan Odorfer: That's a very important question. You're absolutely right. The older folks out there probably remember the Minority Report scene with Tom Cruise, where he's doing all these fancy moves and controls the computer with that. Well, think of this as if you would do this next too. The learning curve you were mentioning, it's also a topic of how long you want to do this until this is more a sports event than an operation off of a screen, right? Your eyes are constantly moving anyway. So before you touch something, before you gesture, or just pointing at something or click a mouse or whatever, your eyes are always already at this point that you want to address. And that's the magic of eye tracking. 

So the question is how do we make sure that, in our standard environment, there’s a steep learning curve that people get familiar very fast with this technology and on the other hand, in a kiosk mode, people get that it's a robust environment, it's a robust operation. It's completely a hundred percent sure operation in terms of that the user knows what's going to happen and what to expect, etc. because this is necessary that people would accept it. And what we came up with is a way to confirm things and rethink from basically his gaze information so that we can predict what he wants to do and why we have done this is because this is something that we are focusing on, so the company itself is seven years old, but, my partner and myself, the founding partners, we are focusing on this technology now for almost 10 years. And we came up with, if I remember the first days and the first month and years, it looked pretty different, in terms of how we control computers today.

So let me explain with an example. If you look at things, a button for example, what it usually does today, it has a so-called dwell time, which basically means time taken between you looking at a button and it triggering within a specific time of say two seconds or whatever. So as always, it's taken too long for a nice interaction and it's too short and therefore too many false positives, if you speed it up. So what we came up with is basically a way that you select within a split second, you select something, you can basically think of in a Windows environment, you can select on the desktop if you click an icon, if you click it once; you select it, if you click it twice to double click, then you trigger it. But you can also look at once, select it and then press return, that's basically the same. So you select it and then you trigger it. And that's the same, what we are doing. So you look at a burger and you select it, right? If you want to trigger this and put this in the cart, for example, then every time you select something, a button pops up that basically triggers the selection and to put it into the cart or whatever happens, forced by this button. So it's always a two step system and that's robust enough, but if you know how to deal with the system, you can do it super fast because our eyes are controlled by the fastest muscles in our body.

So no matter if you are looking from the lower left part to the upper right part, you can do this in a split-second while if you would need to move your hand, that would take much longer. 

David: And if you want to select something, are you blinking or doing something like that to confirm?

Stephan Odorfer: Yes, this would be a possibility to blink, but blinking is also controlled by the autopilot in our brain. So nobody is actively blinking except for these specific situations where you blink an eye to show somebody that you're winking, so that's a specific action, but if you would need to blink to every time that feels awkward, it is possible to control the interfaces with blinking and eye tracking is something that is here for many years for decades, in time. And where it came from is from psychological studies, from marketing studies. We all know these heat maps, search results, et cetera, where it also came from is that it's possible for impaired people to control a computer. So that's the great way and the only way for many people to take part in this world, that is the internet and communication, etc. And if they can only use their eye muscles, because everything else is not possible anymore. Then this is a great way,but there are other ways, better ways to trigger things which are not blinking.

Another opportunity would come up, maybe in your mind would be nodding, but anything like these blinking and nodding has too many false positives. So that's why we came up with this other solution. 

David: So walk me through this, if there's a hamburger chain and you have a self-service ordering kiosk and you're using your technology, I walk up to this thing, what is it telling me right away? 

Is there a message that says you can navigate this whole thing just using your gaze? 

Stephan Odorfer: Yes. It would not be that it's only possible, right? So you should always have a fall back option in this case, this would be touch, right? Because you don't want to force people in a direction you want to offer them a better way or different way in the first place.

And after they experienced it in a better way. So it would be introduced to folks as, “Hey, you can touch me, but you can also just look at me and I will understand what you want to do.” And, based on this very first approach, the system basically understands, “Hey, there's a new customer approaching me”, so the system understands that somebody is looking at the system and it can welcome the customer. And based on this, if it's a new customer who is not familiar with this technology at all, then it's very simple, either he can take a short tour in the situation, which is , I would say something like 5-10 seconds long, basically just to understand what it is and I see great potential in terms of viral marketing here, because, just think about somebody controlling the device just with his gaze, and  his buddy is filming this and putting this on YouTube showing how innovative this solution is basically, right? So he understands, okay, this is how I can do it. And then for example, if he goes through the list of burgers in this case, he doesn't need to learn anything. That system understands that this guy is reading and it scrolls automatically as a biometric. So there's no need to understand something. The only thing you need to understand is basically that you look at a button and you see a little shine around this burger, for example. So that must integrate into the user interface and the corporate identity of the brand, obviously and it gives a little shine so that means it's selected. And then this button pops up and since this is the first time for a user this button popped up, obviously the user will have a look at this button, so that's the way we say, “next time, you're going to look at this pattern. You're going to select this burger to put in the cart, understood? And then you just look at the button.”

And then you've got to go because you don't need to learn anything else. You just know that it's a system that scrolls automatically for me, and you understood this because you experienced this and if I'm looking at a button, okay, this other button pops up and once I'm looking at this button, I trigger it. If I'm not looking at this button, it's vanishing right away after a split second. 

David: So if I decide, I want the cheeseburger with bacon, a prompt will come up and if I look at it, it will confirm that I want that and put it into my “shopping cart”? 

Stephan Odorfer: For example, we have different buttons in such an interface, for example, the amount, so I want to have two burgers or three burgers, what is the difference if you use gaze control instead of touch control or something. Nowadays our eyes are our sensors, they sense information and put it into our brain. What we are doing, it's not only sensing, we are also making our eyes the actors, so they are acting actively.

So for example, if you think about driving in the car and you have both your hands on the steering wheel and  you want to change the radio station. If you're familiar with the car, you know, without having your eyes looking at the center cockpit, where you need to put your hands to turn up the volume or to change the station, right? Because you just know where your hands need to go, but if you need to look at this element, for example, you see +++, you would need to create the information within your peripheral view. If you look at +, you need to create the number that you're currently at, right next to the interface because you need to understand that you are at 3+ and you can now stop looking at +++ because it goes up gradually. Similarly, if you say how many burgers do you want, then you just look at one of our five buttons, one, two, three, four, five, because that way the restaurants know what amount of burgers or salads or whatever people are usually having. So, you don't need to choose 28 salads or something. 

David: So you go through that whole ordering process and then you would use more conventional payment systems like credit cards, or maybe even a phone scanner, NFC tap or something like that. Is there a point because you're already using a camera and you're looking at the retina or the iris of the viewer, could you make payments off the biometrics of that person's unique eye characteristics?

Stephan Odorfer: It’s theoretically possible, yes. And, if you look at many Asian countries, it's already the standard, right? It's not something sophisticated, that's already something that they do on a daily basis. 

David: But they don’t have GDPR there. 

Stephan Odorfer: True. Absolutely true, and that's exactly why I said it's theoretically possible. Biometrical identification, for example, this eye tracker that we are using can also be used to log into your Windows system, using the Windows Hello technology and what it basically does is it's not sending the data anywhere, it’s basically the same if you use your iPhone or your Android phone, that you use the same infrared based camera technology to identify that it's you, but it's only asking, is it you or not? You don't need to have the connection to a database. That's the main difference here.

As I said, it's theoretically possible, but this is not that's neither a focus of ours, nor it is something that is necessary in this case, because what you can actually do is you use a QR code to pay, that's one thing, use a touchless credit card or debit card to pay, so there are many ways of contactless paying in a way. What it furthermore does and I pointed this out a little bit earlier, already. So while you are browsing this, and looking through the menu, basically, what we understand is what are you interested in? Because we know that such an eye tracker collects data at about 90 Hertz, so 90 times a second. We understand where you're looking at and this information can be used to basically understand using this autopilot information, what you're interested in and what not. So in this case, for example, we can say right before the checkout, “Hey, you were thinking about taking this ice cream dessert.”

So why not offer it again at the checkout, but as we know what kind of ice cream you looked at and thought about and based on this case pattern, we understand that you really thought about this, so it's not historical information, it's personal.

And therefore you have a much better conversion rate of having upselling and making the cart size larger. 

David: If I'm a kiosk manufacturer and this intrigues me, I have QSR or other retail clients who might be interested in this, what are the hardware implications for this? Do you need to add a separate PC that just does that processing? Is there a separate, specific camera that you need? Those sorts of things? 

Stephan Odorfer: So an eye tracker consists of three different parts. One thing is the infrared lighting, so that's LEDs like you also have in your iPhone and Android phones today, you have a camera, a solution that is basically the same here. There's a special infrared camera and you have an ASIC, so it's a dedicated chip on board on the eye-tracker itself that does all the math, because through the USB port that is connected, only X, Y coordinates and X, Y set coordinates of your eyes are transmitted. So there's no camera image transmitted or saved at all. Everything is calculated in memory and just not saved at all. Also in terms of privacy, this is a standard equipment that can be easily built into the hinge of a notebook. So it's really small sothe volume you need to put into your existing kiosk solutions is really tiny.

And they're the only thing that is necessary. It needs to be put below the screen so that you can easily track the whole screen range with this. 

David: Okay, so you don't need a separate PC running an Intel or that sort of thing to make all this happen. It can just happen off of a pretty simple hardware setup? 

Stephan Odorfer: While you can do that, it depends on the use case that you want to do. For example, if you want to do the prediction, intention prediction parts that I was referring to, and this is something that is not produced on the eye-tracker itself, that is something that runs in the software on local hardware and therefore you should have an up to date device. This could be an Intel processor because the Intel processes have a dedicated deep learning algorithm embedded that we can use, and therefore much lower CPU consumption needed because it's already built in. So the commands are built into the hardware itself. 

David: So if you had a touchscreen kiosk, you could have both functions like all those stuff that the touchscreen kiosk normally doe, could run on there and your technology could run in parallel. You don't need two separate devices to do all that as long as you've got enough hardware. 

Stephan Odorfer: Yes. 

David: Okay. There was a big fuss recently up here in Canada, where I live, about a shopping mall using cameras. And even though it was anonymous video analytics, it was misinterpreted and there was all kinds of upset about it, even though there's really no reason to be. There's nothing, no privacy invasion happening there.

How do you get past that with customers who worry about it and with the general public? Because even though what you're saying is, it's only the eye coordinates, people are going to see cameras and go, “Oh my God, my invasion, or my privacy is being invaded here!” 

Stephan Odorfer: It is absolutely important. So first of all, it uses a camera, but it's a sensor. So it means that the camera images are not saved anywhere. So that's the first thing. Then in terms of our company, we are based in Munich in Germany and Germany has a very strict privacy law. So even in specific areas, there's this even going further than GDPR requests and for the company itself and for me and my partners, this is a very important topic, because we want to make our vision. 

And our mission is to make computers understand us humans and not us humans to understand how our computers operated. This has been for many years that we had to learn how things work. It's now time that computers understand and predict how they can serve us because that's their duty. So in this way, we need to have a better understanding of how we can serve and therefore we need data. If you don't have data, and say if you want to learn swimming in a pool without water, it's not possible. So you need the data. Therefore we have that.

We have certificates of Germany Privacy, that's nothing familiar outside of Germany, probably, but it's a DECRA, it's called a data audit which makes sure how we handle data, how we process data, how we delete data and how we, anonymize and pseudonymized data and aggregate data. So to really make sure that the data we use, has nothing that can be transferred to any individual. That's very important because I don't want a big company to understand what I'm interested in.

The model that we follow for data privacy is basically, something is on one side of the wall, so that's the local part and then there's a part on the other side of the wall. To make this more plausible, think that you're searching for a result and you need to access data online, because this is something that we also do. If you need to load more information, for example, they are doing an e-commerce search and you're loading more information, more t-shirts that you're looking for. So our way is that we ask for a hundred new results and locally, we only use 10 of them. So the guys can put a hundred results in the system, but they don't know which ten of these hundred are we using and needing. So that's basically how you can get around that somebody else is building a model about the person you are serving.

So that's one thing and thinking about these kiosk solutions where all the data i, on the device anyway, and as nothing is transmitted to a server, to do the local optimization or the local personalization, there's no problem in terms of privacy. Furthermore after the session is done and somebody else appears, then we start from scratch basically in terms of the data and personalization.. 

David: Last question. Is this all what we've been talking about conceptually, or are you in the field with self-service kiosks that are doing all of this? 

Stephan Odorfer: So for now, three- four years, what we are doing is we are equipping large enterprises for their standard places, right?

So that's efficiency in ergonomics and benefits. The same goes for the shop floor, so we have productive environments running in a hands-free touchless interaction, not collecting a burger, but just confirming a step in your assembly process, for example. So that's what we're doing through the pandemic.

We have seen this request from hardware, software and solution providers on the one hand, but also from the customer's side since they are looking for other ways to solve their problems. So this is something that I'm pretty sure we're gonna equip, in a few weeks, for example, a completely touchless QR system of a large company that offers their guests to understand more about the company and understand how to get around, sort of a compass, for example, completely touchless, and that's pretty much the same because you have somebody approaching a terminal, the system says, “Hello!”, when it comes to you and you use it for 1-3 minutes, and then you move on.So that's very similar And, so I'm looking forward to seeing this in kiosk environments. 

David: So the interest is absolutely there, but we're still in fairly early stages of seeing this out in the marketplace. Yes. 

Stephan Odorfer: Yes.

David: Okay. Very nice to speak with you. Thank you so much for spending some time with me.

Stephan Odorfer: Absolutely. Thank you for the invitation. 

ACE Roundtable: Making Connected Experiences Work Now, And Post-COVID

ACE Roundtable: Making Connected Experiences Work Now, And Post-COVID

September 23, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

Advocates for Connected Experiences is an umbrella organization created several months ago, that pulls together the people and shared interests of a variety of organizations that deliver experiences to guests.

That can be in places like retail, in museums, commercial properties or theme parks.

The short form for the group is ACE, and it was pulled together and somewhat driven by the Digital Signage Federation - notably past and present board members like Kim Sarubbi, Beth Warren and Laura Davis-Taylor.

One of the early efforts from ACE has been a monthly series of online discussions about important topics, that pull together top people from member organizations. The most recent one was about connected experiences now and post-COVID, as we all all hope there is soon a post-COVID.

I was the moderator for the discussion, and this is the audio track, which is roughly one hour.

The panelists included folks from Shop!, SEGD, Geopath, the DSF, the Location-Based Marketing Association, Blue Telescope, The Experiential Designers and Producers Association, Retail Touchpoints and AVIXA.

There's a lot of voices and you won't always know who is saying what, but the content is worth any confusion you might experience.

TRANSCRIPT - skipping this episode ... too many voices to sort out who said what. Anything particularly brilliant was not me.

Dr. Erica Walker, Emma Mayes - ColorNet

Dr. Erica Walker, Emma Mayes - ColorNet

September 16, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

If you have been around digital signage for a while, you have almost certainly heard a discussion at some point about accurate color reproduction on screens, and the problems big brands can have with that.

The example used most often is Coca-Cola Red, which is a VERY specific red.

It can be a problem at the display level, but it also has to do with the source. A small research team of academics and students at Clemson University in South Carolina are well down the path of sorting it out.

In their case, the problem was Clemson orange - a very specific shade of orange seen on 10s of 1,000s of shirts, hats and giant foam fingers during Clemson football game broadcasts. The orange shown on TV sets and replay boards is not, in some cases, the right orange.

A research project called ColorNet is using AI and neural networks to make real-time color adjustments on the fly to the broadcast signal - using an algorithm light enough that it can run on an off-the-shelf PC.

I spoke with Dr. Erica Walker and graduating student Emma Mayes about the project, and how the technology might be applied as a low-cost box in the back of digital signage screens - so that networks run by brands can really show their true colors.

The chat is a bit technical, but even I got most of it.

One other note - I THINK at some point I reference Clemson as being an SEC team. Wrong. It's in the ACC. I'm in Canada. Ask me about curling.

This is how you'd reach Walker - eblack4@clemson.edu

Subscribe to this podcast: iTunes * Google Play * RSS

TRANSCRIPT

Emma, Erica, thank you for joining me. Can you give me a rundown on what ColorNet is all about? I know it's a university project that you guys presented at Display Week, going back about a month or so. 

Erica: Yeah, absolutely. Thanks for having us today. ColorNet is an artificial intelligence solution for brand colors to be displayed correctly on screens.

So not a color solution that would display all colors correctly, that solution already exists. This is specific to a brand color, and in this case, Clemson University’s orange and purple. 

That’s because you guys are working or studying out of Clemson, correct? 

Erica: That’s correct. And actually the solution could work for any color. We just happened to use the colors that we see the most on our own campus and in our athletics. 

Which is orange? 

Erica: That's correct. 

So this is a project coming out of the graphics communication department, or is it multiple departments? 

Erica: It actually includes a lot of different departments. Each of us on the project is from a different department. In fact, I'm from graphic communications. The students are from engineering and computer science, a variety of engineering degrees. And then my co-creator, or co-inventor, works in a multidisciplinary department with a focus on data science.

 Okay, so what's the problem you're trying to solve here?

Erica: Yeah, thanks for asking that. It is something that is very commonly talked about at Clemson Athletic games and probably at other universities as well. But, the orange is incredibly recognizable, our brand orange for Clemson fans. And when you watch a broadcast of the football game or basketball game or baseball game, the orange is always skewed. It's always normally skewed towards red. Now, obviously the settings can be impacted by the settings on your screen itself, but what if we could address this at the feed level, at the camera level, at the production level? 

And that would ensure that if Clemson orange is a Pantone color that is going to be color accurate, at least coming out of the feed?

Erica: Exactly. That's really that's the tipper right there is that we don't have control over other people's screens. Like the screen inside your home, we aren't trying to make any adjustments to that. That would be the homeowner or the screen enter the bar that would have to make those adjustments, but we can make adjustments to the screens inside of our facilities. So the big screen inside of the football stadium, we could adjust that cause we have control over it, but the main thing is just having a clean feed, having a feed where Pantone 165 is a recognizable color and it displays correctly.

And why is that a problem either, you know, if I'm a Clemson fan, I know my orange, but, if I'm a Syracuse fan, maybe it's a different orange who's going to know other than the Clemson fans? 

Erica: Right. So, that's a fair question. On any given Saturday, there are over 70,000 people in the stadium watching the game, and so that's a big audience, but in general, we just use Clemson orange as kind of a testbed, for this example. So it could be done for soccer teams, you know, in Europe, the big leagues. It could be done for major league baseball, it could be done for NBA finals. It could be done for really anything where brand color is recognizable to a fan of any team of any sport.

And again, you can't really control the final output, like on my TV, if the calibration is off, it's gonna show it to be orangey-red instead, or wherever. Will this help that at all? 

Erica: In my head, if the feed is better than more than likely, it will show better on your TV. Now that's not true if you've amped up your colors or if maybe, I know there are settings that are specific to gamers that they like, and so if you've changed the color settings on your TV, then that could be a problem, but one of the conversations we've been having with these screen manufacturers is what if we could address this at the screen level as well? But obviously, the goal of artificial intelligence is not to weasel our way into people's homes and make adjustments on their TV.

So that's not the goal, but we do think that we could address it in, think of like large format displays. So if you go to the Coca Cola headquarters, they want their Coca-Cola red to display correctly on the screens that are scattered throughout their entire building or their manufacturing facility, or anywhere where they have the control over their screens.

So kind of thinking of it from the brand level, as much as from the consumer level. 

Yeah, it’s not really the business application here, I mean, you mentioned that there's a patent around it and the idea around that is for really super brand sensitive, color-sensitive companies like Coca Cola, and any number of other ones, that they have more of an assurance that the broadcast advertising is going to look in the color that is really important to them?

Erica: Right now, that's what we're looking at as brand applications. So, as I said, there are solutions out there to solve, like overall, you know, a correct profile so that your TV shows colors accurately. So we aren't trying to necessarily do it across all colors, we're trying to really focus on the brand colors. 

Right. So how does it work and how did you get started on this? This doesn't strike me as one of those things that you wake up in the middle of the night and go, “I must solve this.” 

Emma: Right, so the basic approach that our team took is that we were trying to make it where when you're color-correcting, instead of correcting the entire frame, instead, we're working more with image segmentation. So the current process with athletics is that, oftentimes, they have to pick something in the frame and color-correct to that, and just hope everything falls out. So with basketball games, they look at the court and they say, “okay, the Clemson paw print in the middle of the court has to be brand color. Everything else will just be what it has to be.” 

But we're trying to just get that right. The idea is that, well, what if we can make it so they don't have to compromise? So that way, it can be segmented, So we're color correcting the correct areas and frames as opposed to everything else. The idea was also to decrease the kind of manual burden on the technician when it comes to the color correcting, so we looked at doing image segmentation through machine learning by creating a convolutional neural network. 

I know what those are. 

Emma: (Laughter) Without getting into the nitty-gritty. We usually just look at the acronym CNN, so you don't even really have to know how to spell it, but what I’m saying is, just the gist of it that we basically looked at this game footage, we pulled it and we used Adobe Premiere Pro and the Lumetri color panel and we basically picked the range of colors we wanted to correct. So that way we can adjust it to kind of perceptually that natural approximation of what we're looking at for that color brand, and then we pass in the color incorrect and correct footage into the model and it creates a mask and it's basically just showing pixel by pixel what's the difference in color.

And so the whole idea is that our model is able to generate these masks and automatically generate exactly what those corrections are gonna look like. So once we created this data, we trained it, and then that way it learned how to color-correct to these brand specifications in these image segmentation.

So that way our grass is in a weird color, our court is in a weird color. We're just adjusting the jerseys and the Clemson football fan gear and the audience, so it's fixing the colors that need to be fixed and leaving alone what needs to be left alone. 

And is that because you're segmenting it and isolating certain elements of it, that's how you can do it in real-time or near real-time as opposed to doing it in post-processing?

Erica: What makes it able to do it in real-time is partially the hardware. You need hardware that can run on that. And it really just looks like a desktop computer, like a regular box that you're used to, but we do want it to run it in real-time. And so in order to do that, we try to make everything as slender as possible.

Some neural networks have just millions of parameters that they're checking on and we kept making things smaller and smaller so that it could run more efficiently. Now there is a point where it gets too small, and it runs too quickly and it's not as effective. So that's part of the research piece of this is that the students are learning at what point do we make adjustments to make this efficient versus to make it effective? 

I have this idea in my head, and again, as anybody who listens to me knows I'm not an AI scientist or anything close, is that there is some pretty serious computing hardware, a big server room full of computers doing the work of the neural network, but it's sounding like you're saying this is just like a box? 

Erica: Yeah, it can actually run on something as small as a raspberry pie, believe it or not. It doesn't run in the same frame rate that you'd want to run for an event, but we can run about 8-10 frames per second on a Raspberry PI. You don't need an entire room full of servers in order to process this in real-time, it's very doable.

I don't pick it up and carry it around, but, but you certainly could if you needed to. 

So this is not a million-dollar addition to a TV studio or something? It sounds pretty elemental in some respects. 

Erica: Absolutely, you know, really when it comes down to it and Emma can probably speak on this better than I can, but really all an algorithm is a text file that you have to train, like the real meat of it on our end is training it and making it effective and making adjustments because it is in a new area that you can't just go and Google, “Hey, I'd like this algorithm that can do this.” We're actually doing it and modifying it as we go. 

So for a Clemson football game, if you have, I don't know, 20-25 cameras, whatever it may be. Do you need a processing unit for each of those feeds or is a master feed funnel through one box?

Erica: We only need one. Actually, the way it works is, you're right, they do have like 20 cameras and range from little tiny GoPro cameras up to, you know, high-end broadcast cameras with 4K, and so those are all processing that color so differently.

 But it all comes into live, it's coming into a production studio. So if you watch a lot of athletics, like NFL or, even NCAA, sometimes they'll show you the trucks and inside of the truck, all of those feeds are coming in, and they are making those adjustments on the fly as the feed comes in. They choose which camera feed they want to show, and then it gets projected out and all of that's happening in real-time. 

And so we actually talked about different places that ColorNet can live within the system and the place where we landed it is that if we have it right inside of that production suite, you only need one device or you can have it on the other end of that production suite, and you still only need one device, but then you're only color correcting the feed that's actually going to get put out there, versus correcting all the different feeds on all the different cameras.

Is this a problem that's common to any live event broadcaster or is it defined by the quality of the equipment you're using, like would a local community cable operator have a much bigger problem than let's say Fox Sports?

Erica: The problem is pervasive anytime you have brand colors. I'm gonna show my age on this, but I don't know if you remember when Reese's Pieces was the product that was advertised in E.T. when E.T. came out. And so, you know, even in a Hollywood film, you have a brand and that brand cares about their colors.

And so it is pervasive everywhere, but the piece of equipment actually can run anywhere, it doesn't need a fancy studio, it doesn't need ESPN type quality. It could run at any small studio just as well as it runs here, because once you've trained it's really running on its own. It's capable of doing the work without a lot of manual input. 

So in theory, is this a box, like I could order it, in theory, on Amazon, pull it out of the box, plug it in, plug the feed-in and plug the output in and give it power and off you go, or is this a whole bunch of tweaking and software and behind the scenes to make it all happen?

Erica: To answer that really the box that we ordered, the box that this runs in, it was ordered off of Amazon. It is just like a plain old normal computer box, you know, like a desktop, but the magic happens inside of the training and inside of the algorithm and inside of the adjustment to the code, so it's not really the “special sauce,” so to speak really what happens, prior to receiving the box. 

Right. But do you train it? Let's say heavens forbid that another SEC school uses this, would that box have to be trained for the Crimson tide colors or whatever?

Erica: Yeah, I think you understand a lot more about this than you're letting on, but that is a 100% the case. We would have to train it each time, as needed per color, is our current structure, but I'm actually gonna let Emma jump in on what we're thinking about moving forward.

Emma: When we trained for Clemson orange and Clemson purple, the way our data was set up, it was that you're going to look for these ranges of colors around the brand color so that way, you know what kinds of areas you're going to be shifting to be correct. Our goal is to try and kind of generalize it.

So the idea is, we can give some kind of hardware to deliver to the shader and painter with these corresponding teams. So that way they can change what color it is. So we're going to come up with the new approach to it, where instead of looking for this range of colors, to then shift, we're going to look for these areas. So we're hoping to train so it can pick out the jerseys where the fan colors are and it's very adjustable considering what those colors are. So that way you could pick up this technology and plug it in for a different team and it could work that way instead of just being limited to a specific brand's color palette.

Right. Okay, so I'm a digital signage guy. This is a digital signage podcast. I wonder, of course, what the applications potentially are for the digital signage business. 

You mentioned, early on Coca Cola and how across its a corporate campus and its many corporate campuses really, if it has a signage network with the Coca Cola brand on there, if the output PC or PCs or media players are outputting nominally incorrect colors, this could be put in the middle of it?

Erica: Absolutely. So, that's one approach that we've considered. So let's say that let's use our Coca-Cola campus example. 

They want to ensure that no matter what footage is going on what type of screens, they may have multiple brands, I don't even know, that the Coca Cola red is always correct.

And so in that case, you actually would put ColorNet at the screen level, so we would want to pull it down to a much smaller device, more like that Raspberry PI size, so that you could actually just slap it right onto the back of each screen or each set of screens and have that screen Coca-Cola ready, you know? And so you can sell it that way to a brand owner versus having it at the live video remixed phase. 

Do you sense the addressable market for this has a whole bunch of brands in particular, who are that color-conscious or is it a subset that really cares and others who, you know, “our brand color’s blue” and that's all they say.

Erica: Actually, coming from my background, I was steeped in brand from a print perspective. And so from a print perspective, the tolerance of brand colors on your box or bottle or flexible packaging, is very small. It's measured in Delta Es and they say it's a 2 Delta Es.

Most companies don't want you to be any further off the brand color specs than Delta E. And that's basically just a measurement saying, this is as close as we are willing to purchase the product. Like if it goes over 2 Delta E, we don't want your printed product. And so coming from that background, all of the big brands care, all of them want their color to be correct. 

I know there's an argument going on right now, that might've stemmed out of that recent in AB and SID type conversation, from Display Week. But this idea that screens are actually changing our tolerance for brand colors and at some point, are we not going to care so much about brand colors? Because we are willing to accept them further apart, from the brand spec, because of the screen differences that we see. 

I still think that brands are willing to put money, time, and effort behind their branding in general and that they are going to care if their product looks correct because it is as much a part of their identification as any other part of their business. 

Yeah. That would make sense. I'm sure there'd be some reticence around spending thousands upon thousands of dollars per site to do that, but if it's, as you say, a Raspberry PI device that could just plugin via the HDMI feed or whatever into the display, then yeah, maybe they'd be happiest clients to do that. 

Erica: Yeah, especially for those big brands, I bet you and I've never sat in the branding room for Coca Cola, but both Coca Cola and Pepsi use a color of red, right? I bet you that their branding teams would just go to battle over making sure that all of their products are the correct color of red so that there is no confusion on the customer level of which product you're actually looking at.

Yeah, well, I've certainly heard those stories in the past when it comes to digital signage and Coca-Cola red and a few other colors that the Coca Cola people flip out if it's not right, and they had some big problems with early-stage video walls and things like that and there was a particular product that they really liked because of the saturation levels and everything that gave them as close to the print grant as they wanted to see, I don't know if it was that 2 Ease measurement or whatever you were talking about, but it was good. 

Erica: Yeah, and you know, some companies will have different Pantone colors for their print products compared to their screens. So for instance, Clemson has two different oranges, and when it comes down to it, the Pantone that they've chosen for screen and the Pantone that they've chosen for print products, so the difference between CMYK and RGB, those two oranges look the same. 

So it comes down to this perceptual thing. So it's not always about hitting the same Pantone and it's about the perceptual brand recognition of that orange, whether it's on a car, whether it's on a screen, whether it's on a Jersey, and so on.

Okay. So this is a combination product or initiative of a couple of professors, and I think four students, is that accurate? 

Erica: Yeah, that's correct. We had four students, and then we actually just added a new student this semester. So obviously the great part about students is that they have wonderful, fresh ideas coming into a project. The sad part is that they do graduate and go away, like Emma graduates in December. 

And so, there is kind of this rotation of students who have worked on the project over time. 

So where does it go from here at some point Does this become a company or does it get licensed or was that just so far off that it's hard to really kind of rationalize? 

Erica: Certainly from our perspective, our goals align a lot more with the research end and sharing what we find, but from a university level, we are involved with the university research foundation and their job is to help connect us with potential manufacturers or companies or lines of products that would benefit from us.

And so from the university level, they have a lot of interest in that. I'm not opposed to a company or partnering with an existing company. But certainly, you know, the students getting experience out of this and our personal research goals, our primary. 

In the conversations with the companies provide a lot of opportunities to, have funding and to expand, and to come up with new ideas of how this technology could perhaps be implemented. 

Is there an application as well for things like medical imaging and seismic imaging where life and death decisions or very expensive decisions are made based on the color of some high-resolution image?

Erica: Absolutely. We've been looking at expanding this out into some different applications and you really hit the nail on the head as one of the ideas that our team had bounced around is, what if this could be used to emphasize a lifeboat or something like that is lost at sea, you know, how could we make it really fast and really easy, despite all the reflections that waves make? And we've looked at it as an agricultural thing again, where it's emphasizing, if there are healthy plants or if there are weeds, so it really could be modified and used in a lot of different contexts, just like you're saying.

So what came out of SID in that presentation that you did? Did you have companies or other really smart people coming up or contacting you?

Erica: Yeah, exactly, but not so many from virtual conferences we've found, but when we've done some presentations in person and unfortunately, SID was not one of them this year, which I was super excited about that audience.

But when we have presented in person, it has led to lots of conversations with different companies and ideas of how it could benefit them and their customers. 

Okay, so if there are people listening to this who actually understand it fully, how would they track you down and how do they sort of get involved in this in some way, or get some questions answered?

Erica: We would love to hear from people. Again, it's so exploratory still at this phase, and so hearing what real companies with real customers, what they need, what is their pain point and how could we consider ColorNet as a potential solver of that pain point, just reach out to us. My email is at eblackor@clemson.edu. 

Okay, and you guys have a football team, right? 

Erica: (Laughter) We hope we have a good one again, fingers crossed. 

Is it a challenge because people think so much about Clemson as, you know, a big sports school, football school, when this is a totally gearhead kind of science project with AI coming out of Clemson, do they go, “Oh really, you guys do that too?” 

Erica: Well, we're hoping that we actually solve a problem for our athletic department. So fingers crossed, we've proved it out that it can be done. And right now we're just kind of taking a back seat to whatever Coronavirus brings for this coming season.

But our original intent was to be up and operational for our athletic department this fall, which we're capable of doing, but again, we're just kind of taking a back seat to all the decisions that they're having to make to keep their student-athletes safe and the fans and all of that. 

Which is a moving target right now. That's broadcast may be more important than ever for the next few months. 

Erica: I agree. There's no telling where all this is going to go, but we have our first football game on Saturday, and so fingers crossed, everybody stays healthy and well, and we can get that type of normalcy back for Saturdays. 

All right, Erica and Emma, thank you so much for spending some time with me. I really appreciate 

Erica: This was a lot of fun. Thanks for inviting us.

Nancy Radermecher, JohnRyan

Nancy Radermecher, JohnRyan

August 26, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

Ask a digital signage provider about its target markets, and a hell of a lot of them will list banks among them. But only a small handful of companies are solely focused on the financial services sector, and the best known and most enduring of those is JohnRyan.

The Minneapolis-based company has been providing branch merchandising and messaging services to the banking sector, globally, for decades. It's also one of a few companies who can credibly says it was doing digital signage before the technology had a name that stuck.

I chatted recently with JohnRyan's President, Nancy Radermecher, who has been at the company for more than 20 years.

We spoke about JohnRyan's roots, but also about what's going on today. Bankers have long been in the midst of what they call digital transformation, but the pandemic has turned five-year plans into five month executions.

We talk about the evolution of retail banking, and how digital signage and interactive digital apply. We also speak about what kind of content really does work in banks, and why.

Nancy has a passion for data-driven content, and nerdy stuff like integrating systems. We dig into where she thinks platforms for business, like digital signage, are going.

Subscribe to this podcast: iTunes * Google Play * RSS

 

TRANSCRIPT

Hi, Nancy. I know JohnRyan pretty well. I'm thinking about a number of people maybe don't. So if they don't, can you give the elevator pitch about what JohnRyan is all about? And, we can also get into maybe how things have changed through the years. 

Nancy: Sure. We are historically a retail marketing agency, meaning that our clients are end-users, operating financial retail establishments, and we take a sort of strategic and all-encompassing approach to retail marketing. And within that portfolio, is digital signage. So over the years, digital has become a far more important and central product for us because people have moved a lot of their offline retail experiences into the digital world. And it's from that perspective that we entered the digital signage market. 

Yeah, it seems to me, I can remember that the first thing I knew about JohnRyan is that you had a legacy business where you were doing things like handling the compliance of all those brochures that would be in sleeves and bank branches and so on because somebody had to manage that otherwise the same stuff would be sitting in there for years. 

Nancy: Sometimes that even happens to digital signage, but yeah, you're absolutely right. And when we started in digital signage, it was because we were in the United Kingdom and passed a window of a building society and there they had a stand. On the bottom of that stand was a giant video desk, and then above it, there was a screen and they were making use of a firmware technology where you could actually superimpose changing text on top of a video background supplied by this video desk, which in its day was absolutely remarkable.

And so we thought, goodness, is there something to this multimedia approach to what we do today? And we began the exploration based on that. And in fact, one of the people involved in that project is still with the company today, the original building society project. So it was, oh my god, the early mid-nineties, I can tell you that the word digital signage didn't exist.

So we kept trying to find ways to explain what we thought this could be to one another before there was the terminology that you can apply to it.

I think we're all still struggling to explain what digital signage is to people. 

Nancy: Yeah. Fair enough. 

It's improved, but is the focus entirely on retail banking, or do you service any other sectors?

Nancy: Opportunistically we've stepped outside of retail banking. The company initially was focused on chain retail, conventional retail. We moved into retail banking quite early on and pretty much stayed there to this day. 

And is it just the big whale account banks in North America, or are you working globally and working with banks of all sizes?

Nancy: Yeah, we do tend to work with larger banks. The mega global ones are particularly attractive to us, of course, but we work with banks, say super regionals versus community banks. And we've worked in many different countries and still do today. 

Yeah. You used to have an office in, is it Spain?

Nancy: Yeah, we have a presence in Spain, but the, European offices are in London. 

And when you focus just on retail banking or primarily focused on retail banking, is that advantageous? I strongly believe that's the case that if you're going to be talking to very large companies, you sure as hell better know their business, but I see all kinds of companies who will go in and talk to anybody who is willing to take a meeting with them. And, I've been in some of these meetings and thought you guys don't know crap about this industry. 

Nancy: Yeah. I think there are probably two reasons why domain expertise is important in Banking. One is, I guess the obvious reason and the one you just referred to that, it's a good thing to understand something about the client's business situation, business challenges, business opportunities so that you can help them in relevant ways, but banking, I think imposes a second criterion, which is a very particular approach to security, as you can imagine in it and we would all hope to be the case. 

Why? (Laughter)

Nancy: Yeah, exactly. What on earth do they have that requires security? (Laughter)

So it has implications as to how the system is engineered and it has implications about how data moves and there's a high demand also for flexibility in engineering, which maybe you wouldn't expect, but banks may differ in how they approach their security regime. 

We've over the years had to be careful not to be too prescriptive, in how data is transferred, what kind of media player hardware is used because they have very specific ideas about that. So I think financial services is one where you actually really do need to understand the industry to thrive in it.

When you're in these kinds of meetings, is it more the case may be with a retailer, pure retailer, you're talking about what the system will do for you and with the banks you are talking about, what you can stop the system from doing or preventing it from happening? 

Nancy: Yeah, that's right. That's a very good point 

The other thing that's interesting, and what you just said is, I think, as an industry, I'm always surprised a little bit about how much of the literature that's published by digital signage companies, possibly even us, focus on the benefits of digital signage and the sort of basic understanding. And I feel like banking, probably like a lot of other verticals, really understands that, they know why somebody would do digital signage and the conversation is no longer at that level, “why would this benefit you?” No. 

Yeah, my eyes roll up into the back of my head when I go on a software company's site and see a little Chestnut of what is digital signage.

Oh God. 2020 guys. (Laughter)

Nancy: Yeah, exactly. And I think, the questions about business case ROI, I think those have all been answered for the industry. 

We were talking earlier about digital transformation and how COVID-19 has forced a very rapid acceleration of digital transformation plans. You were talking in terms of going from three to five-year digital transformation plans to things that had to happen in a matter of months or even weeks instead 

Nancy: Yeah. It's interesting, and I was just looking at some more industry literature yesterday, in the banking industry, they've all been pretty clear on the shape of things to come in terms of increasing levels of digital adoption on the part of bank consumers. And with that has come, a general understanding that as time goes on, the number of branches will decline, the nature of the activities that take place in those branches will move from the transaction on cash-based activity toward consulting activity.

And by and large, that was something the industry really wanted to see happen because it changes their cost dynamics quite dynamically for the good. So what's happened now is that there's been a really rapid acceleration of what everybody knew was gonna happen anyway. And in a certain way, that’s kind of welcome news for the industry in the sense of accelerating something that was desired. 

On the other hand at this level of speed, I think it's given people a lot of challenges in the very near term. 

So what's transforming in a retail bank? 

Nancy: Strategically, what's transforming is when and why customers are going to want a physical location. So, as I said a moment ago, it's really going to be far more of an advice and guidance proposition than a transactional proposition. But in the near term, what's transforming is the manner in which that advice and guidance proposition is delivered. So when your lobbies are not open and all the time, when people don't have free access, that's creating all sorts of logistical complexities about how do you let people in the branch, how do you manage appointment traffic? Nobody envisioned that they would have to answer all these questions all of a sudden in one big hurry, that has an impact on digital signage, of course, because it provides an opportunity to actually use digital signage to convey to customers new policies.

Obviously, there are opportunities to manage, customer check-in, and flow using digital tools. The screen's gonna be an important part of conveying where you stand in the queue and what's going out in the branch. In some senses, this is making digital signage a more integral part of a successful branch operation, which is good.

It's more than just a communications tool. And there were other examples of that. I think increasingly people are going to embed digital experiences in the onboarding process. We've all seen these bankers clickety clacking away on their computer terminals when we're opening an account.

Some banks now turn that screen toward the customer when they're clickety clacking. But I think hopefully it will be a full-on multimedia onboarding experience, so seminars and financial wellness or all sorts of things that are going to happen, as the branch becomes more of a center for health and guidance than a teller-counter.

Yeah, I go to a particular bank and it's just a suburban location, so there's not a lot of razzle-dazzle there, but it does have digital signage and it's the same bank I've been banking with for 30 plus years or whatever. So I don't see a lot of other ones, but there seems to be a standard feature set that I noticed there and in other banks in general, where there are displays behind the counter and there are displays in the seating area and maybe there's a display over the ATM bank, but it is generally just being branch marketing, “We're wonderful. We have this new thing. Here's the weather”, blah, blah, blah. And it's not terribly compelling and when I've seen banks of the future, in North America and, particularly in places like Dubai, I've seen things like virtual tellers and remote Financial service advisors, where they go into a little pod and you can discuss with somebody who's on the other side of the city or country.

And those things have been very “branch of the future” sort of things that I've never seen adopted, but I'm getting a sense from what you're saying, that the novelty of that will become much more an operational thing out of necessity. 

Nancy: Yeah, I think that's right. There are a lot of things in what you just said that interests me. To your first comment about the placement of screens inside a bank, you're absolutely right. Where you would typically see them as the areas you describe but what's happening now as banks are moving more toward almost a lounge conception of the branch where the bankers are now untethered from their desktops, and maybe can help you with that with an iPad and in a roving fashion, it really diffuses the problem of where to place your digital media, because now suddenly everybody is milling around in a kind of uncontrolled environment, and there are obvious focal points, dwell areas, sightlines, like there always were in the past, which is a challenge.

But then, on the level of the content and just compelling experiences, one of the things that we've learned over the years through mentors, many different experiments and trials and tests is that it's really important when you're thinking about innovative change to a bank branch that you don't lose sight of the fact that the consumer is seeking utility above all else.

So do you have a really cool idea of a touch screen? And I think we've all seen many of these in branches of the future. It might be cool from the perspective of the multimedia designer who gets to create it and win an award for it. But it's a real challenge to get banking consumers to decide what they want to prolong a visit to their local bank branch in order to interact with content that most people intuitively believe is available to them at home.

Anyway, it's tough to reign in the impulse to, I don't know, saddle a bank branch with all sorts of “cause you can” stuff without thinking long and hard about what customer utility is being imparted. So the example you gave of the video conferences is a perfect example of a high utility, high-value digital investment in a bank branch. And there are all sorts of reasons why doing something like that is valuable to both customers and to the bank versus some of the multimedia poster children that we've had. 

Yeah. Let's do something to connect and gesture and all that and embarrass the hell out of people. 

Nancy: Although you had on your podcast just this week, I think an article about one that made sense, but it kind of proves the point I guess.

Yeah, probably a $2 million popup event by IBM, and that's what everybody's going to do, but it was good. (Laughter)

What is the content based on all those years of experience that customers do want in a branch?

Nancy: This is interesting and actually this is my favorite topic, really. So one thing we've learned, and this will come as no surprise to you or to anybody, is that Financial services advertising on its own is not that commercial for people. And there's a very good reason to use sort of general interest communications in a bank branch as a way to get people used to view the screens at all.

So you mentioned the weather before. Our testing and results in time and time again, whether it comes up as the thing that people remember most and want the most. And it also happens to be very easy to deliver us as so if you can mix and match general interest information with bank information or place bank information in a more general interest context, and, an example that might be. If there's something happening in the mortgage market, tying your mortgage messaging to something that consumers are generally aware of and concerned about is a good thing. We've also seen some kind of interesting results that would suggest that if the ratio of bank messaging is a little bit lower than you might initially think you want, the recall of those messages goes up. And I think that's because there's more sustained viewership of the general interest information. People’s attention is more fixed and focused and for that reason, the bank messaging that crops up intermittent get more attention and more recall, which is really interesting. 

In my exposure to banks, I've certainly got a sense that they're very excited. The bank market is excited about being able to have some continuity between online and broadcast and other mediums and push that same campaign into the branches.

But you're saying that at that point, they're in the branch and they don't need to be sold and drawn into the branch cause you got them. 

Nancy: Yeah, and it can reinforce the value of your brand by providing helpful tips. There's a huge demand for financial wellness information right now, not just because of recent events, which has accelerated it, but also because a lot of younger consumers actually don't know much about money management and want to, so that kind of helpful guidance information is also something people like to see. Another thing that people really want, believe or not, is to see pictures or names of people who actually work in the branch. That is always a highly recalled type of messaging. 

Just casting back to something you just said about content creation for other mediums. I think where this is all headed in terms of digital signage, content production in banking is toward, more and more repurposing assets that were created for other digital channels and bringing those repurposed assets together and to constantly updating, constantly iterating news and information streams.

It’s less of a purposeful agency endeavor where somebody's building a 60s mp4 and more of rethinking it more as a large-format webstream, something like that. I don't know exactly the right metaphor. And I think banks will find that they don't have to spend a lot of money on content production to have a lot of really good locally relevant information on screens in their branches. 

That sounds to me back to the work I did with a very large bank. And, I sat at a meeting where we're talking about content with the agency and I became persona non grata, the devil, the antichrist by suggesting just that what was the point of a 60s spot in a window display that was going to cost a hell of a lot of money when you could be repurposing all kinds of other media assets and automating the content. And that did not go over well with the agency because that was their cash cow. 

Nancy: Exactly. It is interesting because, and I was thinking about this earlier this week that this is one of those rare instances, where to do it better, is also a way to do it cheaper. It's not like you're giving up anything, you're gaining something when you start thinking about digital signage content in a more disaggregated way, just snippets of bursts of information using static assets even that you have. And, our clients have huge repositories of assets and tips and all of these things are available aplenty inside of banks’ asset management databases. And mixing and matching these things creates a really low-cost way to build content, but also superior content, which is just such a great thing. 

Yeah. I assume that bank marketers are pretty savvy and understand this whole concept of Omnichannel and more so than let's say, “regular retailers” or all kinds of other potential clients in that, they have these digital asset management systems and everything else, and they understand automated and dynamic content based on data assets? 

Nancy: I think they do in all of their online applications, but it seems to me that they are generally puzzled by why they can't somehow better leverage their online assets to digital screens. And I suppose that's because maybe we in the industry have not rapidly embraced that model or educated the market to the model that actually, no, it is a logical thought to think that those other assets can be repurposed to digital signage. But you don't see a lot of it happening, right?

So maybe the digital signage industry too has been a little bit in the paradigm of the agency that wasn't so happy with you creating longer-form content, purpose-built for this media versus looking at an alternative way of doing it.

Yeah, you get the sense that even regionally sizes and certainly national and international banks, they are in the thrall of probably multiple agencies and it's in their express interest to control the thinking really, and certainly the budgets of these bank marketers. There's no incentive for them to say, “Hey, you don't need to do all this really expensive stuff. Just do it this way, and we'll surrender to that $5 million.” 

Nancy: Exactly. But I'll tell you what. I think with declining levels of traffic and branches and the general stressors that banks are facing now, in terms of justifying marketing investment at the point of sale, that's going to prompt a change. 

One of the things that gets batted around a lot these days is the whole idea of “interactive” in a bank setting and other retail settings. Is it safe to touch things and all that... 

You know, banks have ATMs, there's just no way around. You can't do voice control, or at least I don't think you can, or I wouldn't want to use that. So you go into a bank, you're already conditioned that, “Yeah. I'm going to use a touch screen and I'll whip up my notes advisor and everything will be fine”. Is there antsiness at all around introducing more interactivity to reduce the one-to-one contact with staffers? 

Nancy: For sure. I'm hearing a lot of focus on touchless experiences, and so trying to figure out how to clone interfaces to people's personal devices or bypass the need for them, that's a huge issue the industry is trying to address because, as you mentioned earlier, video tellers, video conferences, these things are really important to the branch of the future because they become the only kind of financially viable way to deliver certain services to certain branches in the network. So they're essential to the value proposition and will only become more essential. 

So yes, I think there's a lot of work being done and a lot of time being spent on how to make those interfaces appealing and acceptable to people in some of the ways I described. I think on the level of our business, digital signage, thinking back on the concept of utility touchscreens roles for marketing purposes has been very difficult to implement successfully. You've probably seen Microsoft, like those surface tables in bank branches, they came in and then they went away, interactive kiosks came in and then they went away. We've done a lot of things with touch through bank windows, we've done QR codes, we've done scannable brochures, that launch interactive experiences, printing brochures on demand, and all of them face the same challenge that they require a customer to prolong their visit in the bank branch and they're not delivering really clear apparent utilities. So it is just at the level of the basics. The tougher problem with all that, I think, is not just managing people's concerns about hygiene today but just the use of it at all. 

Yeah. It's not as private as going on a touchscreen to look up some health issues, but, if you're going to be doing loans, calculators, mortgage calculators, and things like that on a screen then other people can see.

I don't know if it bothered me all that much, but I'm sure a whole bunch of other people would be very concerned about anybody seeing that. 

Nancy: It's not just that, but you're also likely having in your hand a device that does exactly the same thing, So you can use your phone to do these things when and where you want to do that versus standing at a kiosk, so it's an interesting challenge. 

In terms of banks. you’re focused on retail banking, but there's a whole bunch of bank office space and giant office towers full of banking people and even with work from home, that's not going to totally change, those office towers are not going to clear out.

Have you guys done much work in terms of the back-of-house digital signage for banks? 

Nancy: Yeah, that is actually how we got our start. Our first network was a 900 branch training network within the UK, delivered by satellite because that's all there was, daily kind of huddle and corporate communications. So we've done a lot of that, more focused on the branch and then the corporate headquarters. But the technology as that you would know well drives one versus the other is exactly the same. 

Is it hard to crack the larger opportunity on the back of the house side? 

Nancy: I think it didn't use to be. We got our start prior to things like the internet and email and podcasts and websites. All of those become really viable corporate communications vehicles for the sort of information that we were imparting through our digital networks. So the case needs to be made that multimedia delivery of some of these messages is a superior form for those messages than plowing through an intranet.

And I think that the case can be made, but given all the other things that banks have to contend with in their overall digital transformation, I don't think that's going to make the top of the heap. 

I know that you've spent a lot of time thinking about where all of this goes and you have the benefit, so to speak of working in an already demanding vertical where the security demands are a lot higher. Where do you see things going or do things like PCs and media players and all that will start to go away? 

Nancy: Yeah, definitely there's a move afoot in the world around us toward, edge solutions, and there's no reason to think that digital signage wouldn't be an edge compute solution. What we hear from corporate customers a lot is that they're very frustrated by the proliferation of point solutions in their branches. They'll have a solution for digital signage, they’ll have a solution for POS, solution for managing appointments and on.

And each of these solutions is vertically integrated. It contains a monitoring component. There's a service plan that they have to have with somebody for it. And this kind of really adds up a lot of complexity. So this future of bringing these disparate point solutions together in a sort of commonly managed edge environment, I think is very real and the sort of streamlining that clients that we deal with would really like to see.

So I think those of us who provide digital signage solutions should be hunkering down and really focusing on our software and imagining that it might be deployed in a manner like that in the future. 

So this is a couple of steps beyond the recent and prevalent question of, “Do you have an API?”

Nancy: Yeah, I would say so. Yeah. 

A few months ago now, I think, you guys were acquired by AU Optronics out of Taiwan, a company that had already acquired ComQi, which does digital signage. How is that going? 

I know the AUO people and they're from Taiwan, so they're super nice and super smart and all that, I assume this was a good event for you guys. 

Nancy: Yeah. It's interesting because we remain a very entrepreneurial, agile company as JohnRyan. We're operated pretty much autonomously from the other units in the group. So from a day to day experience, it's actually just the same.

But on top of that is something very nice, which is a huge resource for engineering and the number of patents. I think they have 29,000 patents. There's a lot of people that can answer tough questions within that company. Access and understanding of the really detailed aspects of display technology both now and in the future.

I mean, it’s really a great thing to have that sort of resource available to us and obviously an incredibly strong financial group as well. So that opens up opportunities for subscription-based deals with clients and all manner of things. So it's been going well.

Yeah, there have been instances in the past of hardware companies, display companies, buying software companies, and you just go, “Oh boy, this is just going to meander into nothing.” And that's what happens. But, I've certainly got the sense from Stu Armstrong, who is now overworking with you guys, came from ComQi.

The ComQi experience was just that. They have certainly mentored them and had their back and everything else, but left them alone to do what they needed to do. 

Nancy: Yeah. And I think the interesting part of that might be that in some of these acquisitions by hardware companies buying digital signage companies, they might be viewing those digital signage companies as routes to market for their hardware.

In this case, I think it's almost the reverse where AUO was interested in closer to the customer, more solutions-oriented businesses in order to provide feedback to it about where it is going. And so that's a great role for us to play. We're obviously interacting with people every day on the level of their business challenges and we have good and meaningful insight, I think for them.

So it's a two-way traffic and AUO supplies some display panels, but they're also a supplier to the other manufacturers who produce digital signage displays and other displays. And so there is no agenda that our goal is to sell AUO products in particular only when they get the solution.

Right, but it does give the opportunity. If you're looking at a bank deal that's 1100 branches and 10,000 screens or whatever. You don't necessarily have to buy from a consumer or commercial brand, you can go directly to a manufacturer and cut some of that cost out, which is going to be attractive.

Nancy: Yeah, affordability is really going to be a very big factor for our business going forward. It's going to be interesting to see how people reformulate their offers and streamline them. We talked about content earlier. I think there's going to be a lot of interest in that sort of content approach. Now, when there really isn't the luxury to do it any other way, and that's going to affect every aspect of our business. We've been spending a lot of time over the summer looking and kind of reinventing digital signage. There's some stuff that we're going to be putting out in the weeks months to come, but not taking anything as a given, right? Let's look at the hardware. Let's look at the connectivity. Let's look at how content is created. Let's look at how maintenance is done and just across the board, trying to emerge from all that with a really streamlined, focused approach. 

All right. that was great. Thank you for spending some time with me.

Nancy: Well, it was nice to catch up. Thanks.

 

Stephen Borg, meldCX

Stephen Borg, meldCX

August 12, 2020

The 16:9 PODCAST IS SPONSORED BY SCREENFEED - DIGITAL SIGNAGE CONTENT

There are times when I come across an unfamiliar company and it’s clear, really quickly, what they do and offer. But other times, not so much.

When digital signage industry veteran Raffi Vartian joined a company called meldCX a few months ago, my core response was, “OK, that’s great! Glad you’re sorted out. Ummm, who???”

Since that time, he’s walked me through what the Australian-based company, which is now growing its footprint in North America and elsewhere, was all about. If the company has an elevator pitch, it would be useful if the building that elevator’s in has a lot of floors. It gets complicated.

My simpleton explanation is that the company offers a platform as a service that makes it much easier and faster for software vendors, integrators and solutions providers to stick to what they’re good at. The customer worries about the user experience and key functions of an application, which can sit on top of a meldCX technology stack that has already got things like OS compatibility and scalability worked out.

So, when a client asks a vendor for a solution that could be very complicated, a lot of that complication has already been handled via the meldCX platform. So the job can be accelerated and the costs controlled.

I spoke with founder Stephen Borg, who splits his time between Australia and the U.S. He  walked me through the origins of the company, how it works with software vendors and integrators, and related an interesting and different take on using computer vision to keep facilities and devices sanitized in the midst of a pandemic.

Subscribe to this podcast: iTunes * Google Play * RSS

 

TRANSCRIPT

Stephen, thank you for joining me. you're in Australia, I'm in Nova Scotia. So, I think we're like 14 hours difference in time zones and all that. But, we'll make this work. 

For those who don't know much about meldCX or anything, can you give me the rundown on what the company's about?

Stephen: Yeah. So really, we started meldCX about four years ago and it started as a research project. So I got a team together, internal people, and external partners and customers, and we started it as a reason project and said, what are the common problems in delivering devices to physical space? How can we do this better? 

And what triggered that research was my background in the AOPEN group, the work with Chrome and Fujitsu, we had a common thread of problems and they were just assumptions at the time. But we looked at them and said, okay, what are the things that stop a rollout? Where are the unnecessary costs? What stops it in its second phase? Because we find a lot of customers don't know what they don't know until they get three years into their cycle and find out they hit a brick wall. So what are all those points? Then we researched and built some codebase.

We did that for about two years before we decided to commercialize it. And then we won two or three significant global customers out of that research and decided that meldCX would take its own path, become its own entity, seek its own investment. We commercialized it in the middle of 2019.

And in that short period of time, we have around 80 customers, like enterprise customers across four continents. So it's been a massive take-up, so it's been a very exciting journey.

Now was the research work for AOPEN or for Fujitsu or was it JV or…?

Stephen: Yeah. So I started it as a piece of work that I kicked off with a team looking at what are the common problems. So we looked at Fujitsu data, we looked at AOPEN data. We worked with various customers, we worked with different partners, major providers and it really started as just a bit on a paper.

Then from there, we decided, there is some significant gap here and there are areas that we can help. So, we took that and said, okay, let's do some test cases and initially, it was funded by myself and a team of interested people and we had some great support from AOPEN and the Acer group, around some goodwill, some developers, some research analysts and the like.

I'm just trying to wrap my head around what the outcome or output of this would be. A little bit of what I talked about with Raffi was about the idea of making Chrome devices like the AOPEN Chrome basis more extensible so that they could work with things beyond just plugging into the back of a computer or back of a monitor, that sort of thing that could work with printers, other external devices, that sort of thing.

Is that kind of the gist of it?

Stephen: We found two things, Chrome taught us a lot. Okay. I helped architect the first sort of commercial Chromebox with Google and what we quickly found was there are two distinct development camps and that's across signage, kiosk, and interactive devices. 

So you have a development camp that looks at quite thick architecture, is very versed in modifying drivers or going deep into windows and modifying it and bastardizing Android, so to speak. You have that sort of skill set and then you have a very dynamic backend, highly functional, web first orientation, and these developers needed to meet in the middle somewhere.

And we discovered the hard way with Chrome because we were trying to bring customers across to this new web-first environment, without the tools or the plumbing to get across. And then conversely, you had some really cool tech coming down the pipe that didn't even consider a physical environment. You know, physical security, reliability, no popups on a screen that people can't touch.

So that was phase one and we ended up enabling some big clients on Chrome, doing some things such as payments, ThinkPad integrations, biometrics integrations, accelerators like Movidius, those types of things, we enabled in Chrome initially.

And then we made a decision to say, okay, what we want to do is take these digital building blocks and if a customer uses them, they should be able to run on any operating system. So now, if a customer has built their app using meldCX tools, that can run on Android, that can run windows, soon Linux, without changing the codebase from Chrome or vice versa.

Would you call this middleware?

Stephen: Yeah. in some ways it's middleware, what we do is quite unique. The middleware covers three stages, that is the original deploy piece. Typically middleware just allows you to build and propagate. What we do is we allow you to either build using it or using our existing modules.

So we have a customer that wanted to add some AI elements to the existing app and didn't have the team to do it, and they just plugged in some of our modules. Or you can run applications side by side and make them talk to each other. So we want it to be really flexible. We didn't want to have to tell people that you must build in the Meld to use Meld. 

That's a big leap and it's something that's a bit of a barrier at the start. So we didn't create or force any customers to go into any proprietary language or tech. You can just add these tools or refer to these tools and create a high-end device, even if you've had no experience building a kiosk per se.

So we let customers take content or apps they’ve created on Adobe or web apps and turn them into devices that can operate online, offline, talk to local peripherals, etc. using our tools and our sort of process. 

I'm thinking about a creative agency that I knew in New York a few years ago that was working with a very large athletic wear company. And I was doing some consulting. These were guys who were very good at creative and very good at interactive user experience and all that sort of stuff. But they were being asked to do everything, coding hardware, sourcing, and putting together the touch screen overlays, the whole nine yards. And I'm thinking about what they were saying, “We're having to do this because our client wants us to do it, but this is not our skillset at all. Please help.”

What would happen if that kind of a company was then told, “We want you to do this interactive user experience, we also want you to do payments off of this, and we also want it to interact with smartphones or that sort of thing.” and they would be deer in the headlights. Is this the sort of thing where if they knew that meldCX exists, they could jack their way into that and it would enable them to produce something that's hardened, secure, and reliable?

Stephen: Yeah, exactly. So we just had a customer roll-out, which was really unique. Contact tracing applications for pubs and clubs and bars, and it was an agency and their integration aspects were quite complex, so we enabled the Chrome device to do Apple Pass and Google Pass so they can send digital tokens or loyalty cards to their customers, tapping as they walk into the establishment, it would contact trace, plus give them points.

Now the agency scoped out a year project. We delivered that in two months on meldCX, right? Because all they needed to do is focus on the UI and we had already done all the certifications, the Apple compliance, the Google compliance, and really, they just used our widgets, got it up and running, and the customer is rolling out now. 

So in that case, not only did we help the initial build process but ongoing, Meld manages the OS. So Meld won't let the OS go past the build. So for example, if it is Chrome, and you've built your app on, v83, it won't allow Chrome to update past v83 until you've told it to update. And if it picks up a critical security patch, it might notify you of the impact of that, and you can test it without having a physical device. You can test it in an emulator. 

In this case, they were using a development team in Melbourne, a development team in India. and they tested virtually using our emulator so they don't even need physical devices. So that's a great example.

I know “middleware” is a very simplified way of trying to describe it, but since I'm a simple person, would I describe this in certain respects as a middleware as a service?

Stephen: Yeah, so we have two essential products or product lines. One is a PaaS (Platform as a Service) product. so that is someone that wants to build their own app. It gives you all the tools. It gives you things like PCI compliance, advanced security, even tokenization of devices, a whole range of builder widgets so you can use those blocks. 

In fact, we've had quite a few, ISVs build their applications or move their applications across Meld, really just reappointed to the Meld resources rather than rebuild anything. And then they can go off and run multiple operating systems. We were dealing with a signage provider (that we’ll announce soon) and I think they had a team of 30 devs and they had seven dedicated to operating systems and after moving across the Meld, now they don't have any dedicated to the operating system, which is a sunk cost, they have them focusing on features. 

So that's one of the things we're providing and we also help them become an enterprise. So now they can use our certifications, our security compliance, our SSO, all those things that corporate entities need as a minimum requirement, they can just utilize what we've already done, right?

I completely get what you're saying. My worry would be that in a hyper-competitive marketplace, like the digital signage software marketplace, many of these companies compete on price. Layering you in adds more cost. 

Although, you've said it removes a lot of costs. Because in this case, this company doesn't need seven guys. or engineers, focused on operating systems, but how do they balance that out? Does it become net savings?

Stephen: Look, there are two aspects. Signage, you're right, it’s very competitive and I wouldn't see, for example, an entry-level signage player, that's playing a web URL, having the need for something like Meld, unless it was their first foray into Chrome and they didn't want to do the development, they just want it to point to us. 

On the signage space, we're working with partners that want to move up the food chain. And what I mean by that is they want to be an enterprise, they want to have multiple touchpoints, within the customer and they potentially want to use other aspects of Meld.

So Meld has its PaaS platform and it does have SaaS modules as well. So we have products such as advanced machine vision. And in Meld, you can schedule machine vision models or AI models. You can schedule content and apps all in the same way and pair them together.

We just worked with a global car company, and they have an app that they spent a lot of money building on, an agency built it and they wanted to add some visual elements...

An agency costing a lot of money???

Stephen: (Laughter) Yeah, and I looked at it and went oh well, but they didn't want to go back to the agency and wanted to use Meld to add some AI elements and what we ended up achieving for them is that we used the cameras within the devices and gave them content sentiment analysis, tokenization of people using it, so if they went into a pop-up that was in a shopping center and then later went into the car dealer, the car dealer wouldn't get any personal details, but they'll see, “Look, this family of four was playing with this car in a shopping center for an hour and they got to this configuration price point.” and that dealer would end up with that profile as they're walking in.

They did that and a lot of that was prebuilt with those tools in Meld. They just used those tools and ran it side by side with the application, and that was a six-week process. So they're the type of customers or partners we're using where they're taking it to that next step.

And also, even some small signage providers when they go enterprise now with all the security requirements like SSO, data restriction compliance, GDPR, all of that's really overwhelming for them. So we take care of that. 

As long as they stick to the guidelines we set in place, they can be compliant too, and they can really pump above their way.

Is one of those guidelines is that you have to use Chrome devices or is that just one of the ways you can do this?

Stephen: No. So, we use our Chrome and Windows. So one of the guidelines is, for example, the hardware. We're hardware agnostic as well so as long as the hardware has some security components like it has a TPM or we can access the firmware to create, assign digital devices, we allow it into our network. So we won't allow a customer to say add an Android device because that can't be secured. 

We are PCI level One, so the highest PCI standards. So we will ensure that the devices meet that standard if they want to be able to use any of those certificates, if that makes sense. 

Yeah. Google made a big splash about four or five years ago, about entering the digital signage market. And at that point, there were a number of Chrome devices and there was a feeling, and I was among them and I thought, okay, this could be a big deal, but then it never really went too far. There's only a handful of companies that are using Chrome, Chromeboxes and other devices, but for the most part, the world has moved on and Android came back and Android is getting a lot more serious and there are lots of special-purpose devices, set-top box kinds of devices that are being used. 

I think it's interesting that you started down the path of Chrome, but I suspect it's going to be important to communicate, at least in the context of the digital signage ecosystem that this is not just a pure Chrome play and they don't have to go down that path.

Stephen: Yeah, that's correct. And look, we love working with Chrome. I think it's come a long way. And, one of the reasons why I think adoption wasn't so rapid in this space is what I explained earlier. You have a lot of people who are used to hacking an operating system and bending it the way they want it to bend, but then you tend to compromise security, you compromise feature updates. There's a lot of compromises when you're doing that. So what we tried to do is take the Chrome methodology, make Chrome more adaptable to this market. 

We're doing offline content, talking to peripherals, running multiple apps at the same time. So I haven't come across anything of light that we can't do in Chrome that you can do in other operating systems. I think Chrome forces you to be compliant, to maintain security standards, and there are not that many players that have the skills to work within that compliance framework. 

So initially we made that easier and now we use that same compliance framework, which is the class-leading for an operating system, across the other operating systems. We've worked very closely with Microsoft to control updates, and we're about to release some dedicated Android devices that are secure, have digital certificates back and forth, and can only play up that generated from Meld. 

So even if it's your own APK, if it wasn't generated from Meld, it won't have authority. So it's super secure. You can still update the Chrome browser within Android, independently of Android, so it's very flexible but maintains that security first principle.

You mentioned machine vision and I believe the product is called Viana. You're bringing computer vision at least in the context of digital signage, into a pretty crowded marketplace in terms of a number of companies that are selling variations on video analytics for audience measurement and so on.

What's the distinction about Viana that sets you apart from the other guys?

Stephen: Sure. So Viana actually didn't start with a sort of visual analytics, in the way we see it in Signage. It started on some really deep learning projects. One, which you can look up, it's called Project Sally, where for our post postal services in Australia, we did handwriting recognition and package recognition to be able to sort parcels at a kiosk device.

You can go up to this kiosk, drop your handwritten parcel on the plateau and it will detect if it needs a customs declaration, pre-fill most of it, dimensions, calculate the cost and everything else. 

So that was quite deep learning because if anyone tried to scan my handwriting, you’d need a really decent model. 

For mine, it's not going to work.

Stephen: (Laughter) So we did that, and we got our synthetic data set generating 14 million impressions a week or variations of handwritings, and we started saying, okay, how do we do things a little bit differently around visual analytics? How do you go beyond just saying, okay, this is how many females or males of this age have walked past this screen? You know, how do we take it to the next level? 

It’s kind of I've been there, done that thing.

Stephen: Exactly, right? And we're not going to engage in something that's highly saturated unless we can add some differentiation.

So we sat down and worked through it and said, okay, what are we trying to actually get here? So we're not just trying to get the number of eyeballs, but what we're trying to get is the amount of attention time, we're trying to get the content sentiment to understand the content sentiment and how that relates to other systems, other processes or advertised media. 

So we not only built our own custom model that looks at content sentiment analysis but applies various metrics and various sorts of triggers and integrations that make it really easy to do more. And then we took it a step further and all the training models are based on synthetics.

So we haven't gone out there and pointed a camera at the public and started training. You know, you have a natural bias doing that. So what we've done is all our computers, all our training data is synthetically generated. It doesn't have the ability to even understand race, let alone be skewed to race but it does understand things like age, gender, beard, glasses, brands of clothing they might be wearing, are they wearing a hat in a hat store? It gets really detailed and we can pick up quite a comprehensive profile of that person that is entering your establishment, and you can start drilling in and say, okay, I want to understand more. I'm thinking of bringing game caps into my store, how many people were in caps of this type, and you can really start drilling down and understanding that level of detail.

And one of the modules that have come out of Viana is at the moment called Sami?

Stephen: Yup. In fact, we started this project prior to COVID. 

It's an interesting story. I was sitting in one of our offices, and being from Melbourne, I was there quite late and the cleaners came in. And they came in, checked in, sat at the conference table, cleaned that table. They were there for two hours, emptied the bin, and left. And I'm thinking, this has to be a better way to understand what's being cleaned, what's being done, how do we go away from this clipboard on the side of a wall saying this has been cleaned and we don't know if it's been done?

So we started that project and we got the provisional patent for it and then COVID hit and we said, okay, this is ideal for COVID. What it essentially does is that it can plug into any camera system, or digital camera system or you can use it with a USB camera if you choose to, and it looks at hand emotion, distances, body distances from objects. And what it starts to do is, for example, if you have a conference room, you can highlight a table or highlight those areas, it will start self-learning the digital structure or framework of that room and it'll start monitoring touchpoints.

So I might say, “After each conference, I want an SMS to go to X person to go clean it.” So what would happen is once that person goes, who gets an SMS (or Messenger or any type of message), walks into the room, accept it, and the camera where she looked for the hand motions that it's been cleaned and it will show the hotspot areas that people were engaged with prior to cleaning.

So you can really take any inanimate object and point these cameras towards it and set a threshold. You might say, after three interactions or people standing nearby, we want this cleaned and you can even set a range for hands or range for airborne, it is if someone's coughed in that area. You might want to set a meter range around that individual going in, and not only it will encourage you to clean, but it will record a complete digital manifest of that. So you'll get that pop-up, you'll engage with it, you'll clean it.

It will monitor all the hand motions. We don't keep any details of faces. We've done a lot of training on what a cleaning motion is, and it will send you an image of the hotspot areas, and if you've cleaned those hotspot areas, it'll send you a notification saying you're done and it will keep a central digital manifest of it all.

So I think that's interesting for the business environment but I would imagine where it could get really interesting would be in things like food processing environments, where they're worried about Listeria outbreaks and everything else, where you've got to have cleaning compliance versus the boardroom table.

Yes. It should be clean, but it's probably not the end of the world. If it wasn't.

Stephen: That's right. We're getting companies coming to us in all sorts of spaces around this. Food preparation areas, pharmaceuticals. We have an interesting one right now, a very, large spectacles retailer and what they're doing right now because of the COVID situation is every hour, they have two people in-store, retail associates, cleaning every single spectacle in the place. So they're using us to have focus areas. So the cleaning can be more frequent, but less broad. 

And in fact, you can have triggers so you can even use it on any kiosk, doesn't matter what operating system, what OS. We have a module that sits on the kiosk and can monitor touches and it doesn't require a camera and it will send you information saying this kiosk has hit a threshold.

We're working with an airport right now, and the first thing it would do is if that kiosk hit a threshold, it will shut down that kiosk and encourage you to go to the next chaos until someone can clean it and as you go into that cleaning mode, it will show you the impressions and all the hotspots where most of the touches were.

And if you're using a virtual eraser, it will not let you finish that process until you've rubbed all of it out and it will even ask you to say, please clean the PIN pad, please clean this and that, as a digital checklist. And that's rolling out this month as well. That's part of the Sami suite, 

So, if I'm charged with cleaning these things (and please God, I don't want that job) but, you would see a screen that has what amounts to a heat map on it that's visualizing what in particular needs to be cleaned, and as you wipe that down, the heat map colors are changing or the heat map is going away and it's going back to the normal screen. Is that a good way of describing it?

Stephen: That's correct. And the main point is the digital manifest, so the person that's cleaning it will have to be standing right in front of it. They'll click on their phone, they could have got a message of some sort, and then it will go into that mode, and you can associate that person with that compliant cleaning regime.

The first thing it would do is make you clean the whole surface and then it would make you focus on areas and have that sort of visualization so that way you can have a deeper clean and there’s some AI behind it, how many touches or how long the engagement is versus how much you have to clean up for based on the type of solution.

So if it's Clorox, it might say, this is how long you need to do it. Customers can vary that in the dashboard. So they can say, it's this many impressions or I want this clean for X minutes. I want us to not allow customers to use it, and we've just had a customer that wanted to add facemask to that, so it stops the kiosk for anyone signing into that kiosk or using that kiosk unless they have a mask. They just added two Meld modules together and created that scenario.

Yeah. I worry about a lot of these companies that are coming out with hardware products that are squarely focused on dealing with pandemic issues right now, because it's going to take longer than most people expect, but this problem will go away and I wonder if these products will be relevant at that point, versus what you're describing, which is great in the current, health safety environment, but it's going to work for a whole bunch of other reasons down the road in a whole bunch of other different scenarios.

Stephen: Exactly. So we originally started these concepts because a lot of customers use our touch screen for food or food ordering. Coli is very stubborn and it stays on surfaces for a long time, so we originally started this for things such as Listeria, Coli and general cleanliness and bacteria. 

And we're very lucky to have one of our large teams, or actually I opened at the time in Taiwan because they see a lot of work around this space and Taiwan seems to be leading the world around this space. They seem to be the best in the best state for COVID.

So we've got a lot of feedback from them on this, and having a purely hardware solution to solve this problem which may or may not be a short term, but it really needs to be multi-use and have a broader purpose than just this, and really that's what we're focused on.

It's good housekeeping. It's allowing you to create a digital manifest and to make sure it's actually done because we actually did a research piece before we started. We're working with a very large building management company, so they own buildings in the city, and then they go lease them back out and manage the buildings. And they didn't actually know, compliance. The only method of compliance they had was when the cleanup badged in and badged out, that was it. They didn't know if anything was done, which could be dangerous, in this environment. And also, just generally, you want to know if you're paying for that cleaning service that it's actually being done.

Yeah. Where's the company at, in terms of, working its way into the marketplace? You've hired Raffi Vartian. I believe you have a guy down in Dallas or Austin. Where are you at and how do companies engage with you? 

Are you working through a channel, is it a direct connection? How do people find meldCX and get the conversation going?

Stephen: Yeah. So we started off, in Australia. so we've got quite a big Australia team and some resources in the Asia Pacific region. We decided to kick off the US because, one, we have quite a few customers that are in flight, so you'll see, by the end of this year, them going live with some significant rollouts.

So we hired two people initially, that is, Edward Doan, he’s actually ex Chrome, he was part of the core Chrome team and led parts of that team. And he's come across to lead the meldCX business in the US and Raffi Vartian. And we tend to look at it in an interesting way, in that, if the project is unique and we believe that projects can come down the pipe and can be used by our partners, we will engage the customer directly for a period of time. 

So for example, in the first version of Sami, we worked closely with our customers who allowed us into their environments and create training data and do that type of thing, and then we'll make that sort of publicly available and work with partners to deliver to those clients. 

So we are a partner-centric business. We tend to use ISDs and SIs of all types. We do work with some agencies, and some consultancy firms as well but we do have some multinational, bleeding-edge type use cases that we will engage indirectly and then make those facilities or even sometimes the sample code available to our partners so they can go and modify it and do it for their customers.

Okay, so to find you guys, is it meldCX.com?

Stephen: Yup. meldCX.com.

Perfect. All right, Steven, thank you so much for taking some time with me from all the way over there in Australia.

Stephen: Yeah, thanks for your time. 

2019 DSF Coffee And Controversy

2019 DSF Coffee And Controversy

October 30, 2019

A couple of weeks back I was in New York for the annual Digital Signage Federation Coffee and Controversy event, which I moderated.

I was able to grab audio last year and post as a podcast, and this year we managed the same. The audio is OK, at best, but you should be able to hear just fine.

Your big challenge will be discerning who is saying what, because the session was me and five great panelists, all with terrific insights and experience.

The topic was privacy and proof, as it relates to tech being used for retail and advertising insights. The speakers were:
- Dylan Gilbert, Policy Fellow at DC-based PublicKnowledge
- Laura Davis-Taylor, the Co-Founder of Atlanta's HighStreet Collective & LivingRetailLab
- Kym Frank, President of New York-based Geopath
- Amy Avery, Chief Intelligence Officer at New York agency Droga5
- Jeremy Bergstein, CEO of New York agency The Science Project

By all accounts it was a great session that could have gone another hour or more. The DSF is working on video clips, as well, which will be available to its membership.

Please note it is double the length of a "normal" 16:9 podcast.

Subscribe to this podcast: iTunes * Google Play * RSS

 

Maris Ensing, Mad Systems

Maris Ensing, Mad Systems

October 23, 2019

I wouldn't want the job of trying to boil down what Mad Systems does to an elevator pitch, unless it was a very tall building with a very slow elevator.

Based in Orange County, California, Mad Systems is technically an AV system designer and integrator, but these are not the guys you'd hire to put in some video-conferencing gear and some screens in the lobby.

It's not unfair to suggest the Mad in Mad Systems has to do with Maris Ensing and his engineers being a bunch of mad scientists. Go through the company's project portfolio and you find out they've put together a steam-driven aircraft and a 20-foot high tornado.

The company also did a big part of one of my favorite projects - the alumni center at the University of Oregon, which has a set of very tall, but moveable stacked LCD displays.

Ensing and his team have got involved in all kinds of things over 20 years, but in our chat, he talks a lot about a new AV management system the company has built from nothing - called Quicksilver. Among many things, Mad has patent applications underway for a new kind of facial color and pattern recognition system designed to instantly personalize visits to places like museums.

I'll let Ensing explain that and other things. This was one of my easier podcasts. He had a lot to say and there was little room for questions. Enjoy. 

Subscribe to this podcast: iTunes * Google Play * RSS

 

Matt Schmitt, Reflect

Matt Schmitt, Reflect

October 9, 2019

Reflect is one of the longest running companies in the digital signage sector - operating out of Dallas since 2001. The company built up its CMS software business largely in retail, but in early 2017 did something of a pivot into ad scheduling and targeting.

I wondered, when I first got walked through what's called Ad Logic, why Reflect was going in that direction, given the addressable market seemed a little limited and companies like Broadsign had a serious head-start on competitors.

Turns out that Reflect was responding to client needs for something that was kinda sorta digital OOH, but was less about agency-driven media scheduling and more about retail and place-based networks that wanted to monetize their screens with endemic advertising. So in a medical office network, they wanted to schedule and runs ads for, say, big pharma and medical device brands.

I spoke with Reflect's president and co-founder Matt Schmitt about his company's journey, and how Reflect has evolved from a software shop to one offering everything from strategy to creative work and media sales.

Subscribe to this podcast: iTunes * Google Play * RSS

 

Michael Provenzano, Vistar Media

Michael Provenzano, Vistar Media

August 14, 2019

Programmatic media buying and selling for the digital out of home marketplace has been going on for many years now, and grown a lot more sophisticated, and a lot more used.

Just as the digital OOH business has matured and expanded in the last few years, so have some of the key players - notably New York City-based Vistar Media, which has been at it now for eight years and is seeing crazy-good growth these days.

 I spoke with co-founder Michael Provenzano about the online roots of his business, and how he took much of the same approach into a medium and supporting tech business that was, at the start, kind of all over the place.

 We had a great chat talking about what Vistar does, why it built its own CMS, the role these days of data, and whether programmatic is the answer for media-based digital signage networks, or maybe just PART of the answer.

Subscribe to this podcast: iTunes * Google Play * RSS

 

Fab Stanghieri, Cineplex Digital Media

Fab Stanghieri, Cineplex Digital Media

May 22, 2019

Canadians all know Cineplex as the dominant movie theater chain in that country, and the Toronto-based company has also been expanding its reach, in recent years, into other related lines of business.

Cineplex now has entertainment-centric restaurant-bars, is bringing Top Golf into Canada, sells out of home media and runs a thriving digital media group that's doing most aspects of digital signage for major enterprise customers in Canada and beyond those borders.

Fab Stanghieri was a senior real estate guy with Cineplex, charged with building and managing the company's movie house portfolio. He had digital media added to his responsibilities a few years ago, and while it was unfamiliar territory at first, he's embraced digital to a degree that it is now his primary focus in the company.

I was passing through Toronto a couple of weeks ago, and Fab kindly took some time to show me around new office space, which is set up to help ideate, deliver and manage digital signage solutions for Cineplex clients.

 

Subscribe to this podcast: iTunes * Google Play * RSS

 

Alberto Cáceres, Trison

Alberto Cáceres, Trison

February 20, 2019

Being in Amsterdam for ISE recently offered a chance to meet up and talk to some people who are squarely focused on business on the other side of the Atlantic.

I knew Trison was a major player in digital signage solutions in its home country of Spain, but I didn't realize the company had a far greater reach than that. In 2018, Trison was in the middle of 2,500 digital signage and related jobs, in 76 countries.

The company started 20 years ago doing audio solutions, in northwest Spain, and has grown into the major solutions provider for retail digital signage in Europe and beyond. A Coruna is home base, but Trison has offices in Madrid, Barcelona, Paris, Shanghai, Mexico City and elsewhere.

I spoke with CEO Alberto Cáceres outside the ISE press room.

Subscribe to this podcast: iTunes * Google Play * RSS

2018 DSF Coffee and Controversy, in NYC

2018 DSF Coffee and Controversy, in NYC

November 7, 2018

I was in New York last week for the Digital Signage Federation's annual Coffee and Controversy breakfast event - a panel discussion that each year brings together some of the most influential leaders in the digital signage industry.

I'm on the DSF board and my fellow board members drafted me to run the panel - with Chris Riegel of STRATACACHE, Jeff Hastings of Brightsign and Beth Warren of Creative Realities.

There's only so much controversy you can whip up around digital signage, but I tried ... and if anyone in this industry was going to stir up some shit, it was Chris. He didn't disappoint, nor did Jeff or Beth.

The women who ran the AV for the event very kindly generated an audio recording for me. This is about twice the length of a normal 16:9 podcast, but if you didn't have the chance, time or budget to get to New York last week, you can have a listen to what was said.

Subscribe to this podcast: iTunes * Google Play * RSS

 

Rich Ventura, NEC Display, on ALP

Rich Ventura, NEC Display, on ALP

October 31, 2018

NEC Display has been fairly quietly involved in analytics for a long time now, but it just got very serious and noisy about that capability, with the launch of something called ALP - which is short for Analytics Learning Platform.

It's a retail intelligence program that uses cameras and other sensors, AI, big data, cloud computing and network appliances to give retailers a better sense of what's going on in their stores.

Tied to digital signage, a retail intelligence platform can optimize messaging based on who's in there, how long they're in there, and the historical patterns of what those people tend to buy. The gold for retail operators is understanding conversion ratios - the what really happened stuff when messages were pushed.

There is no shortage of retail intelligence platforms out there, but none that I know of built from the ground up with signage as a core element. I spoke with NEC's Rich Ventura, who drove the project, to talk about ALP's roots, how people in the signage ecosystem plug in, and how it all fits. 

Subscribe to this podcast: iTunes * Google Play * RSS

David Labuskes, AVIXA

David Labuskes, AVIXA

September 20, 2017

I was in the Washington, DC area last week for what turned out to be the rebranding of Infocomm as AVIXA - a loose acronym for the Audiovisual and Integrated Experience Association.

The trade association had invited me, and a pile of other trade journalists, for a press conference and follow-ups about … something. They wouldn’t say what and had us signing NDAs promising we wouldn’t spill the beans ahead of time.

It’s a lot more than just a name change for Infocomm, which will still be the name of the big annual trade show and versions of it in other countries. The new AVIXA branding reflects much deeper thinking by the InfoComm board and executive team, which is run by CEO David Labuskes.

On the tail end of a crazy-busy launch day, and in the middle of a cocktail party, I managed to grab Labuskes for a chat, to find out what AVIXA is all about, and what it  means for people and companies in the digital signage industry.

Subscribe to this podcast: iTunes * Google Play * RSS

David Mou, Pilot TV

David Mou, Pilot TV

May 23, 2017

I was introduced to Taiwan’s Pilot TV and the company’s product evangelist David Mou by some of the folks who invited me over to Beijing recently for a speech at InfoComm China. Mou wanted to tell me about his company and thought it would make good podcast material.

I tried to dodge that, because I’m about as excited by digital out of home ad networks in c-stores as I am about traffic jams and Jane Austen movies. Soooo many ad networks like that have failed.

But he’s a persistent guy, and when we met at that Beijing trade show, he rattled off what was going on, and pretty quickly convinced me this was not another no-hoper “built it and the advertisers will come” screen network.

These guys are heavily into analytics and proving to packaged goods and other brands that this is a medium that works, and they already have 8,000 screens running in Taiwan and beyond.

Subscribe to this podcast: iTunes * Google Play * RSS

Rodolfo Saccoman, AdMobilize

Rodolfo Saccoman, AdMobilize

May 16, 2017

There’s nothing all that new about digital signage networks using video analytics to get some sense of what’s happening with audiences near screens, but AdMobilize is not just another company peddling the same old stuff.

I spoke with CEO and Founder Rodolfo Saccoman about a product and service he says rolls up a wide range of different measurement technologies under one simple, harmonized platform.

Saccoman comes out of the IT side of the hospitality industry and he totally gets the importance of customer service and experience. He also understands buzz, and the insatiable appetite out there for cutting costs. That may explain, in part, why the company’s AdBeacon measurement device runs off the extremely buzz-worthy Raspberry Pi board.

We get into a lot of things in our chat - including how he thinks computer vision and artificial intelligence will work in the future in digital signage and digital out of home.

Subscribe to this podcast: iTunes * Google Play * RSS

Ke-Quang Nguyen-Phuc, Quividi

Ke-Quang Nguyen-Phuc, Quividi

April 12, 2017

A lot of companies have come in and out of video analytics for digital signage, but the one constant has been Quividi - a French company with an anonymous pattern detection product a lot of people will tell you is the gold standard for this tech.

I sat with CEO Ke-Quang Nguyen-Phuc during a break at ISE a few weeks ago, and got the rundown on the company and what’s going on with this technology, now and in the future. We talk about the distinction between face recognition and face detection, and what the technology can do for network operators and brands.

We also get into the insights delivered by audience analytics, including how long people really look at screens, and what screens generate the least attention. It's a little technical here and there, but you'll learn stuff.

Subscribe to this podcast: iTunes * Google Play * RSS

Play this podcast on Podbean App