Latency and reliability
Posted: 17 Jan 2016 17:02
I have been working with z-wave.me now for just over a year. I love the concept, really want it to work, but am frustrated by the overall reliability and performance of the system. I am not pointing fingers at the software but the whole z-wave system. I would like to share my experience and see if anyone can give me pointers to make improvements. The network I have is as follows:
18 devices in total:
• Fibaro Dual Relays x 3
• Qubino Dual Flush relays x 2
• Fibaro Multi-Sensor x 2
• Philio Dual relay x 1
• Fibaro Universal Binary Sensor x 3
• Everspring SP103 PIR
• Plug Switches TZ68 x 3
• Z-Wave.me Remote Control
• Aoen Labs Multisensor 6
• Pi 2 Controller with Z-Wave chip: ZW0500
Software:
• RaZberry by Z-Wave.Me
• V2.2.0
• Serial API 05.04
HARDWARE RELIABILITY
In the course of 12 months I have had 2 Fibaro Dual Flush relays fail. I replaced them with Qubino Dual Flush relays. Within 3 months, one of those devices seems to be on the edge of failing. It appeared dead, I tried to exclude then re-include, but only 30% of the points of interview have worked the rest remain un-interviewed after countless attempts. I fear another replacement is due.
A failure rate of 3 out of 20 devices is 15% within 12 months. This is a crazy figure. In a hobbyist environment like mine you might live with it (although you should not!), but this kind of reliability would never make for commercial deployment.
LOSS OF CONNECTION
On a monthly basis one or two devices seem to lose their interview connection and I am forced to re-interview. Is this a hardware issue of a software issue? I don’t know. It is frustrating and time consuming for me to have to repair the network with such frequency.
INTERVIEWS
A number of my devices have always failed to interview completely:
• Fibaro Universal Binary Sensor – fails with Alarm Sensor
• Qubino Dual Flush relays – multiple items failed: AssociationGroupInformation, MultiChannelAssociateion, Version
I don’t know what kind of impact this has, but I can’t fix it.
SOFTWARE
I have lived through installing the Z-Wave.me software over numerous iterations from v1 to v2.2.0 I learned the hard way not to install “RC” versions, which on several occasions caused me to lose the whole set up and I had to start again. Right now I find v2.2 quite stable and mostly bug free. It has improved greatly from the early days, well done to the team for all your efforts – please keep going!
However I do get frustrated that the Expert UI seems to regularly forget the selected Device Description for many of my devices.
Also I really wanted to do Sensor Value Logging, but in the end turned this App off as it seemed to make my whole system perform very badly.
LATENCY
Much of what I want to do is quite simple like to turn on lights when I enter a room. I use existing burglar alarm PIR sensors wired to the Fibaro Universal binary sensor as inputs and then the relays to turn on the lights. I do all the logic in the Pi Controller using Rules and Scenes. I know I could associate devices directly but then I don’t get the added control I can have in my logic, for example only when I want to go into Auto Mode, only when it is dark….
The problem is that the delay between triggering the PIR and turning the lights on is long and variable. The best is about 1 second, normally around 2-3 seconds, but sometimes a whole minute can go by. It means I walk into a room, in the dark and I have walked out the other side, before the lights come on behind me. Again not practical for commercial use. I have two questions:
• What is the cause of the latency (I monitor my Pi CPU and it is less than 4%)?
• Why does the latency sometimes get very extended?
SUMMARY
Overall the picture builds to a system that is unpredictable, unreliable and requires regular maintenance. Don’t get me wrong, I LOVE the idea and I REALLY want it to work. I have invested a good deal of time and spent a good sum of money. It just doesn’t work well enough.
Am I alone? Do others have the same problems? Is this the best I can expect? I would really like to hear the Developer’s opinions. Any pointers would be gratefully received.
18 devices in total:
• Fibaro Dual Relays x 3
• Qubino Dual Flush relays x 2
• Fibaro Multi-Sensor x 2
• Philio Dual relay x 1
• Fibaro Universal Binary Sensor x 3
• Everspring SP103 PIR
• Plug Switches TZ68 x 3
• Z-Wave.me Remote Control
• Aoen Labs Multisensor 6
• Pi 2 Controller with Z-Wave chip: ZW0500
Software:
• RaZberry by Z-Wave.Me
• V2.2.0
• Serial API 05.04
HARDWARE RELIABILITY
In the course of 12 months I have had 2 Fibaro Dual Flush relays fail. I replaced them with Qubino Dual Flush relays. Within 3 months, one of those devices seems to be on the edge of failing. It appeared dead, I tried to exclude then re-include, but only 30% of the points of interview have worked the rest remain un-interviewed after countless attempts. I fear another replacement is due.
A failure rate of 3 out of 20 devices is 15% within 12 months. This is a crazy figure. In a hobbyist environment like mine you might live with it (although you should not!), but this kind of reliability would never make for commercial deployment.
LOSS OF CONNECTION
On a monthly basis one or two devices seem to lose their interview connection and I am forced to re-interview. Is this a hardware issue of a software issue? I don’t know. It is frustrating and time consuming for me to have to repair the network with such frequency.
INTERVIEWS
A number of my devices have always failed to interview completely:
• Fibaro Universal Binary Sensor – fails with Alarm Sensor
• Qubino Dual Flush relays – multiple items failed: AssociationGroupInformation, MultiChannelAssociateion, Version
I don’t know what kind of impact this has, but I can’t fix it.
SOFTWARE
I have lived through installing the Z-Wave.me software over numerous iterations from v1 to v2.2.0 I learned the hard way not to install “RC” versions, which on several occasions caused me to lose the whole set up and I had to start again. Right now I find v2.2 quite stable and mostly bug free. It has improved greatly from the early days, well done to the team for all your efforts – please keep going!
However I do get frustrated that the Expert UI seems to regularly forget the selected Device Description for many of my devices.
Also I really wanted to do Sensor Value Logging, but in the end turned this App off as it seemed to make my whole system perform very badly.
LATENCY
Much of what I want to do is quite simple like to turn on lights when I enter a room. I use existing burglar alarm PIR sensors wired to the Fibaro Universal binary sensor as inputs and then the relays to turn on the lights. I do all the logic in the Pi Controller using Rules and Scenes. I know I could associate devices directly but then I don’t get the added control I can have in my logic, for example only when I want to go into Auto Mode, only when it is dark….
The problem is that the delay between triggering the PIR and turning the lights on is long and variable. The best is about 1 second, normally around 2-3 seconds, but sometimes a whole minute can go by. It means I walk into a room, in the dark and I have walked out the other side, before the lights come on behind me. Again not practical for commercial use. I have two questions:
• What is the cause of the latency (I monitor my Pi CPU and it is less than 4%)?
• Why does the latency sometimes get very extended?
SUMMARY
Overall the picture builds to a system that is unpredictable, unreliable and requires regular maintenance. Don’t get me wrong, I LOVE the idea and I REALLY want it to work. I have invested a good deal of time and spent a good sum of money. It just doesn’t work well enough.
Am I alone? Do others have the same problems? Is this the best I can expect? I would really like to hear the Developer’s opinions. Any pointers would be gratefully received.