Through the Interface

Realtime visualization of sensor data from the MX3D bridge

We hit a major milestone with our research into smart infrastructure, this week. After a massive push over the last 3-4 weeks (which in itself was built on work done over several years), we were able to deploy a system that measures – and reports in realtime – the performance and usage of the world’s first 3D-printed steel bridge. To give you a quick sense of some of the results of this work, here’s an image of Dasher 360 showing the 3D model of the bridge with skeletons walking across it with the bridge’s accelerometer readings displayed as a... Read more →

The MX3D bridge at Dutch Design Week

On Sunday I flex across to Amsterdam, once again, this time to take the train down to Eindhoven for Dutch Design Week. Alex Tessier and Michael Lee – colleagues who had barely recovered from the last trip across before coming back to help the project with one last big push – had arrived a few days before me. When we got to the bridge – on oversized cycles borrowed from the hotel but clearly intended for giants – the sky was still a little overcast. Alex and Mike got cracking on fixing some stray sensors and connectors. Our “home”... Read more →

Digital robot twins

This week I spent quite a bit of time talking to people about digital twins that include skeletons and robots. For skeletons I’ve been working off real data from static JSON files – not yet time-series database-resident – but for robots I’ve just been relying on simulated movements. Until today, that is. Josh Cameron, an Autodesk Research colleague in Toronto, sent through a video he took of a robot while streaming its data to our time-series back-end. This helped me interpret the data (reasonably) correctly, at least for a first pass. You’ll notice the virtal robot is a different... Read more →

Forge DevCon Europe

It’s been a whirlwind few days. The trip up to Darmstadt on Monday went relatively smoothly: I had to take four trains to get there, and only missed one connection (the one in Frankfurt, but thankfully I could hop on another train and arrive just 10 minutes later than planned). Still, the nearly 6 hours of train passed reasonably smoothly. After arriving in Darmstadt I met with Sander Lijbers and Tony Thuy, who’d organised to host some customers from the Netherlands. We went for dinner at a nice restaurant serving local food. When in Germany, eat schnitzel! It was... Read more →

Coming to a Forge DevCon in the US or Europe? It turns out I’ll be talking at both!

Well, this just happened: after having had three generative design-related classes accepted for AU 2018 (well, really two were accepted and one ended up getting a repeat slot at the Connect & Construct pre-conference), I wasn’t due to talk about anything I’ve been doing lately with the Forge viewer. Which frankly was a shame, because between robots, skeletons and streamlines, as feel as though I’ve got lots of fun stuff to share, at the moment. That was until yesterday, when I got pinged by Stephen Preston (for the US DevCon) and Cyrille Fauvel (for the European one), to ask... Read more →

Adding smarts to the MX3D bridge

I’ve spent most of this week in Amsterdam with colleagues from the Toronto office. Our group descended on the MX3D offices in the funky NDSM wharf area of the city, to make a big push and help get the world’s first robotically 3D-printed steel bridge – and its supporting systems – ready for Dutch Design Week. Most of the team stayed in a hotel right next to MX3D, but we did get the chance to take the ferry across to “the mainland” (it isn’t really: everything is connected, it just seems that way) from time to time. It was... Read more →

About Bristlebots

My world seems to be filled with robots, these days, whether seeing how they can be used in architecture and construction, animating them inside Forge, or seeing them 3D print steel bridges (I’m at MX3D again, this week). It makes me think I should probably dust off my HoloLens app for making robots dance in mixed reality: once we’re using data inside the Forge viewer-powered Dasher 360 to show the position of a robot at a particular moment in time, it’s hardly a huge leap to show that in XR. Anyway, I should get to the point… Given this... Read more →

Animating robots in the Forge viewer

The inspiration for this post has come from a variety of sources. (Feel free to skip this preamble where I talk about the history of the project: as much as anything it’s so I remember myself how things happened when I come back to this post at some point in the future. ;-) My colleague, Simon Breslav, worked on an initial implementation in Dasher 360 that animated robots – and even mapped stress information to their surfaces – for a demo shown at AU 2017, back when I was travelling around the world with my family. One of the... Read more →

When in Rome

It’s been a great few days in Rome, at the Forge team’s first ever Roman accelerator. Things kicked off on Monday morning, as we occupied the conference room at Rimond’s office in Rome’s Trastevere district. As is usual at these events, there are a number of companies doing really interesting things: several of them have specifically mentioned Dasher 360 as their inspiration for visualizing additional (even IoT) data in the Forge viewer. Very cool. Yesterday I joined Peter Schlipf to visit Roma Tre University, where we spent some time with Stefano Converso from the Architectural Design department, as well... Read more →

Counting down to Forge DevCon Europe

We’re just a few weeks away from the 2nd European edition of the Forge DevCon. It’s being held in Darmstadt on October 16th, the day before this year’s AU Germany. This is a free, English-language* event where you can learn all about the capabilities that are currently (and will soon be) available through the Forge platform. (* I’ve seen a number of emails asking whether the event will be in German or English, presumably due to its proximity with a German-language event. I can confirm that the entire program will be in English.) Here are some “reasons to attend”,... Read more →

Displaying streamlines in the Forge viewer

The integration of the MeshLine library into the Forge viewer – which we’re using for the display of skeleton data, as we saw last time – has opened the door to displaying all kinds of other cool stuff. Back in 2014 colleagues in Autodesk Research published a SimAUD paper entitled “Towards Visualization of Simulated Occupants and their Interactions with Buildings at Multiple Time Scales”. It explored the use of various visualization techniques to display how a building’s simulated occupants interact with it. One of these techniques was called Speedlines (we also use the term Streamline): The original visualizations were... Read more →

Displaying skeletons in the Forge viewer – Part 3

Right then… now it’s time for the really fun stuff. Looking back over this series of posts, we introduced it then looked at adding simple geometry to the Forge viewer, followed by animated skeletons and animated skeletons with fixed meshes attached. Today we’ll dig into making our animated skeletons properly visible. Having given up on using a SkinnedMesh, the remaining option was to tweak the underlying display of the SkeletonHelper object. This proved challenging for all sorts of reasons. Back in Chrome 55, it seems the ability to show lines with widths broke in three.js. This was fixed in... Read more →

Don’t miss these sessions at the Forge DevCon in Las Vegas

The Forge DevCon is a great place to dive deeply into what’s possible – and what will soon be possible – with the Forge platform. I’m involved in the organisation of the Las Vegas DevCon – being held on November 12-13, 2018 – in that I help lead one of the tracks. When the first DevCon took place, back in 2016, I was track-lead for the AR/VR track… these days I’m co-track-lead with my old friend Cyrille Fauvel for the Complementary Technologies track, which incorporates topics such as AR/VR, AI and robotics. All the really fun stuff, basically. ;-)... Read more →

Displaying skeletons in the Forge viewer – Part 2

We introduced the series, then looked at adding simple geometry to the Forge viewer, followed by animated skeletons. Now it’s time to look at approaches for making these skeletons more visible. As mentioned last time, today’s post is a bit of a “non-post”: it talks about adding a SkinnedMesh to be animated alongside an underlying skeleton, which we already know doesn’t currently work inside the Forge viewer. But it’s instructive to see the process in case either the situation changes or someone wants the code for a pure three.js application. Basically it’s possible to add a SkinnedMesh into a... Read more →

Displaying skeletons in the Forge viewer – Part 1

After introducing the series and seeing how we can add simple vertex and edge geometry to a scene, today we’re going to start digging into the guts of the problem of how to display skeletons in the Forge viewer. This proved to be a really interesting process: I ended up learning a lot about how the Forge viewer and the three.js library it uses both work. I don’t recall the full history of the Forge viewer’s use of three.js, but recent releases have all depended on r71. This can present challenges, largely because three.js is (at the time of... Read more →

Adding 3D geometry to a scene in the Forge viewer

In the last post I introduced the series where I’ll be talking about the journey I’ve been going through to add skeletion data inside Dasher 360 (which is, of course, based on the Forge viewer). The first step I took along this path was to find a way to add simple 3D geometry into an existing scene inside the viewer. This is something we do in a limited way inside Dasher – we use point clouds to represent the locations of sensors, for instance – but I wanted to work out the right approach for doing this for data... Read more →

Forge skeletons and disappearing signs

It’s been a strange few days. It’s the very last week anyone will be working from Autodesk’s Neuchatel office. This really hit home when the Autodesk name and logo were removed from the building, last Friday. Photo credit: Estelle Ormrod I salvaged an A (the were signs on the front and back of the building, so this wasn’t the only one) for my daughter’s bedroom. It’ll be some kind of reminder of the wonderful years we’ve all spent here. The staff departures have been staggered, over the last 6 months or so: there have been leaving aperos for people... Read more →

A visit to regenHU and farewell to Philippe

I had the pleasure of a visit from Peter Schlipf of the Forge Partner Development team, this week. Peter had come across for a number of reasons, but the first “task” was to catch up with Philippe Leefsma and wish him well for the next stage in his career. We met for an “apero” and then headed into Neuchatel for a lovely farewell dinner at the historic Cardinal brasserie. It was a lovely evening, but bittersweet: I’m very happy to see Philippe moving into an interesting role at an Autodesk customer, but sad that we won’t be working together... Read more →

AEC Hackathon Berlin 2018

I’ve just arrived back from Berlin, which I was primarily visiting for this year’s German AEC Hackathon (last year’s was in Munich, which I attended briefly in the weeks leading up to our big trip). I was there with my family, and we had a great time visiting the city when I wasn’t needed at the Hackathon. Let’s start with a few tourist shots. On Thursday we visited a few places, such as the Holocaust Memorial… … and the Berlin Cathedral, which was beautiful inside but had stunning views across the city from its roof. We were staying with... Read more →

Forge DevCon 2018 in Europe

The Forge DevCon is coming back to Europe, specifically to Darmstadt, Germany (on October 16) ahead of AU Germany (on October 17-18). While the content for AU Germany is presented in the local language, everything at the Forge DevCon will be in English. And it’s free to attend! Registration is now open for the event. There’s a great line-up of speakers delivering a packed agenda, so be sure to sign up soon. If you’re also interested in AU Germany, here’s a video showing a few highlights from last year’s event: I don’t yet know whether I’ll be attending, myself:... Read more →