Updates

The hard drive in RFO2 has given us trouble before. A year ago, we swapped out the disk, the enclosure, and even the computer itself. For a while, it was smooth sailing, but then started acting up again.

So, after replacing the disk and enclosure again, we tried the power and data cables. That was an improvement, but still not 100%. And since we can’t observe without the hard drive, anything less than perfect isn’t good enough.

We’ll be headed up to Ferguson again soon, this time with a new idea in hand, to try to put this trouble maker to bed once and for all: a solid state disk. Smaller capacity, but completely different performance, electrical, and other characteristics.

Since RFO2 wants to be an attention-hogging snowflake, here’s the work from its perspective. LaserSITTIE is, by far, my favorite piece of maintenance equipment. There’s nothing like sitting when we previously had to bend over the instrument, or kneeling on it instead of the often-sweltering roof.

Many of LaserSETI’s parts are challenging to print, simply due to the required function of the part and the limitations of Fused Deposition Manufacturing (FDM), aka 3D printing. We’d worked out most of the kinks in the original design of the parts, but one has been giving us trouble.

This is the bracket that holds the “horz-cam” but also, underneath in the bay visible above, holds the router that connects all the various computers that make LaserSETI operate and analyze.

The near side is where all the ethernet cables plug in, so obviously can’t be a solid wall. The highlighted support pillar is large enough to grow into the camera bracket higher up, but small enough to not cause a problem with the cables below. But sometimes, if everything below didn’t print 1000% perfectly, it became a long lever arm that got pushed around by the print head and eventually broke off.

It’s a large part, taking 75 hours of machine time and about $15 in raw plastic. So a print failure more than halfway through is a frustrating waste of time, money, and effort. And it’d happened one time too many times. There are a plethora of factors, mainly the printer and type of thermoplastic, but many variables aren’t realistic to control precisely, such condition of the machine, ambient temperature and humidity, feedstock humidity and other imperfections.

We’d tried fixing it “the right way” by printing a support pillar on the side, meant to be broken off once the print job finishes. But it wasn’t getting a solid enough connection to the model and too often failed in its one job.

As the saying goes, “if you want something done right, do it yourself.” So we carefully crafted a brace from scrap wood, it fits tightly, and we’re expecting this will get the job success rate up, from maybe 65% to more like 100%!

As you know if you’ve been following LaserSETI for a while, we’ve got 10 new instruments we’re building and there’s a lot that goes into them.

It takes 27 days of continuous 3D-printing to make all the parts for just 1 instrument–assuming the printer ran continuously, which it can’t unfortunately.

After months of printing steadily, the LaserSETI team convened to clean and check all the parts we’ve printed thus far. There’s a lot!

If you’re like me, you like numbers: It took 6 people 4 hours process them all which, with 120 parts, works out to 12 minutes per part. More importantly, this is 43% of parts required for the next 10 instruments, although only 35% of the print-hours it will take. That’s great because there’s less overhead in printing larger parts!

It seems things are slowly returning to normal on Haleakala. The power has been more stable <knocks on wood> and this is the second night in a row of those gorgeous clear skies. We’ve got a lot of observing time to make up!

We’ve also got an exciting announcement coming up about data from Maui. More on that soon!

No less than 75 days after a large storm hit Maui, we heard from the instruments on Haleakala today!

The storm knocked out both power and fiber to the summit and it’s been a long and bumpy road getting power and connectivity back. The turmoil caused all sorts of secondary damage: breakers, generators, routers–all had to be replaced as problems were discovered sequentially. Sometimes temporary repairs had to be undone and redone. Sometimes replaced components had to be replaced again. We’re very grateful to the tenacity of the IfA team, as well as the workers at MECO and Hawaiian Telecom.

As you can perhaps read from the graphs, tonight the humidity was 100%, a strong indication you won’t be seeing any stars. But, as a system test, we observed anyways for a short period and–happily–everything performed as expected. Unfortunately, utility power was lost again, near 10pm local time.

We were only online for a handful of hours, but it’s so nice to know that, after a 2.5 month sabbatical and torrential ice storm, everything is still in great shape! Fingers crossed for more stable power from here on out, and getting back to the science!

One of my favorite aspects of SETI work is the scientific breadth required. While no one can be an expert in everything, every corner of human knowledge has the potential to affect SETI theory or practice.

So while this video does discuss spectroscopy, I hope you’re now in the muod for some mind-bending atomic chemistry that’s admittedly only peripherally related to LaserSETI.

After watching the video, in case you’re wondering: yes, it technically is an isotope of hydrogen since its atomic number is the same. Its nucleon count, however, is zero. If that seems odd, just wait, it gets better. Since there’s a third type of lepton, there’s not one but two hydrogen isotopes of nucleon count zero. 🤯

If your head is hurting by this point, perhaps you should drink a nice, cold glass of dihydrogen monoxide.

We lost power at RFO from about 8am to 5pm today. Everything came back online as expected, however, and we’re observing now.

Not a packet yet from IfA. They found the problem, though: the network was damaged in our building. Physical repair completed, and (eagerly) awaiting reconfiguration to bring us back online.

There’s always a lot going on with LaserSETI. It’s easy to be super focused on the operations and observational data but, just like overall SETI 9-dimensional haystack, the LaserSETI project is similarly multifaceted, and we’re always trying to make progress on all its different dimensions.

A picture is worth a thousand words, but in this case, closer to a thousand hours… of 3D printing time. Here’s the receiving bucket containing the parts for the new instruments, waiting to be cleaned and put to use:

We’ve done so much printing, in fact, that it’s time to swap out the printing surface for a new one. It’s not hard to spot the difference, is it? And, with a shiny new surface, it’s a good time to print the parts that are a little more delicate in the first layers, like the sunshade that protects the cameras’ shutters from the beating sun.

On some of those other dimensions, here’s a few things happening right now:

• Replacement of a misbehaving hard disk in our long-term storage array, and rebuilding the double redundancy of the 100TB volume
• Copying a subset of the data to ship off to a budding student partnership to study the data
• Estimates for LaserSETI’s usefulness at capturing Ultra-High Energy Cosmic Rays
  • Spoiler alert: not as good as we’d hoped, because the chances of seeing an event are proportional to how spread out your sensors are on the ground
• Working with a mechanical engineer to iron out the kinks caused by heat transfer in the cutting process when fabricating our stainless steel enclosures

It’s the best night we’ve had at RFO in at least a month. Lots of stars, clear, not too much moisture, few to no clouds. 🔭 Hooray!

At IfA, however, the saga continues. Power had been “restored” via generator, then the main network cable was fixed… and re-fixed. Then we lost power from the generator, had to replace a major breaker after ordering a replacement from off the island, and now mains power and generator are both up.

As you might have concluded by now, there was a lot of damage to the equipment on the mountain from the storm in December. It’s not clear what was from direct storm damage, power fluctuations, or other secondary causes, but clearly there’s still more to repair because… we still haven’t been able to reach the instruments, despite general connectivity being restored for a third time this month.

My hope is and endeavor will be that this is the last post about what’s not working, and the next one has only good news. Next week? Fingers crossed. Stay tuned and thanks for thinking good thoughts for us!

And not the cartoon kind! 🐦💫 The Bay Area isn’t done with rain storms, and this definitely isn’t a great observing night by any standard, but it’s so nice to see stars again. It’s been weeks!

The news isn’t quite as good from Haleakala, unfortunately. Hawaiin Telecomm repaired the fiber, decided they needed to redo it, redid it, and yet we still haven’t made Contact with the instruments. Checking multiple times per day hasn’t seemed to help. Something about a “watched kettle never boils” I think?