Publications Lists     [ all BibTeX ]  

We address the problem of distributed unconstrained convex optimization under separability assumptions, i.e., the framework where a network of agents, each endowed with local private multidimensional convex cost and subject to communication constraints, wants to collaborate to compute the minimizer of the sum of the local costs. We propose a design methodology that combines average consensus algorithms and separation of time-scales ideas. This strategy is proven, under suitable hypotheses, to be globally convergent to the true minimizer. Intuitively, the procedure lets the agents distributedly compute and sequentially update an approximated Newton-Raphson direction by means of suitable average consensus ratios. We show with numerical simulations that the speed of convergence of this strategy is comparable with alternative optimization strategies such as the Alternating Direction Method of Multipliers. Finally, we propose some alternative strategies which trade-off communication and computational requirements with convergence speed.

We consider the problem of building a transitional model of an initially uncalibrated camera network. More specifically, we discuss an Hidden Markov Model (HMM) based strategy in which the model’s statespace is defined in terms of a partition of the physical network coverage. Transitions between any two such states are modeled by the distribution of the underlying Markov Process. Extending previous work in (Cenedese et al., 2010), we show how it is possible to infer the model structure and parameters from coordinate free observations and introduce a novel performance index that is used for model validation. We moreover show the predictive power of this HMM approach in simulated and real settings that comprise Pan-Tilt- Zoom (PTZ) cameras.

In this paper, we consider the problem of designing a distributed strategy to estimate the channel parameters for a generic Wireless Sensor-Actor Network. To this aim, we present a distributed least-square algorithm that complies with the constraint of transmitting only integer data through the wireless communication, which often characterizes Wireless Sensor-Actor Network embedded architectures. In this respect, we propose a quantized consensus strategy that mitigates the effects of the rounding operations applied to the wireless exchanged floating data. Moreover, the approach is based on a symmetric random gossip strategy, making it suitable for the actual deployment in multiagent networks. Finally, the effectiveness of the proposed algorithm and of its implementation as an open-source application is assessed and the employment of the procedure is illustrated through the application to radio-frequency localization experiments in a real world testbed.

The knowledge of the size of a network, i.e.\ of the number of nodes composing it, is important for maintenance and organization purposes. In networks where the identity of the nodes or is not unique or cannot be disclosed for privacy reasons, the size-estimation problem is particularly challenging since the exchanged messages cannot be uniquely associated with a specific node. In this work, we propose a totally distributed anonymous strategy based on statistical inference concepts. In our approach, each node starts generating a vector of independent random numbers from a known distribution. Then nodes compute a common function via some distributed consensus algorithms, and finally they compute the Maximum Likelihood (ML) estimate of the network size exploiting opportune statistical inferences. In this work we study the performance that can be obtained following this computational scheme when the consensus strategy is either the maximum or the average. In the max-consensus scenario, when data come from absolutely continuous distributions, we provide a complete characterization of the ML estimator. In particular, we show that the squared estimation error decreases as $1/M$, where $M$ is the amount of random numbers locally generated by each node, independently of the chosen probability distribution. Differently, in the average-consensus scenario, we show that if the locally generated data are independent Bernoulli trials, then the probability for the ML estimator to return a wrong answer decreases exponentially in $M$. Finally, we provide a discussion as how the numerical errors may affect the estimators performance under different scenarios.

This paper considers a variation of the 17$^{\text{th}}$ century problem commonly known as the Newton-Pepys problem, or the John Smith's problem. We provide its solution, interpreting the result in terms of maximum likelihood estimation and Ockham's razor. In addition, we illustrate the practical relevance of these findings for solving size-estimation problems, and in particular for determining the number of agents in a wireless sensor network.

The paper considers the classification problem using Support Vector Machines, and investigates how to maximally reduce the size of the training set without losing information. Under linearly separable dataset assumptions, we derive the exact conditions stating which observations can be discarded without diminishing the overall information content. For this purpose, we introduce the concept of Potential Support Vectors, i.e., those data that can become Support Vectors when future data become available. Complementary, we also characterize the set of Discardable Vectors, i.e., those data that, given the current dataset, can never become Support Vectors. These vectors are thus useless for future training purposes, and can eventually be removed without loss of information. We then provide an efficient algorithm based on linear programming which returns the potential and discardable vectors by constructing a simplex tableau. Finally we compare it with alternative algorithms available in the literature on some synthetic data as well as on datasets from standard repositories.

The request for very accurate 3D reconstruction in several applications is leading to the development of very large motion capture systems. A good synchronization of all the cameras in the system is of fundamental importance to guarantee the effectiveness of the 3D reconstruction.
In this work, first, an approximation of the reconstruction error variance taking into account of synchronization errors is derived. Then, a Kalman filter approach is considered to estimate the cameras synchronization errors. The estimated delays can be used to compensate the synchronization error effect on the reconstruction of target positions. The results obtained in some simulations suggest that the proposed strategy allows to obtain a significant reduction of the 3D reconstruction error.

We consider the distributed unconstrained minimization of separable convex costfunctions, where the global cost is given by the sum of several local and private costs, eachassociated to a specific agent of a given communication network. We specifically address anasynchronous distributed optimization technique called Newton-Raphson consensus. Besidehaving low computational complexity, low communication requirements and being interpretableas a distributed Newton-Raphson algorithm, the technique has also the beneficial properties ofrequiring very little coordination and naturally support time-varying topologies. In this workwe analytically prove that under some assumptions it shows local convergence properties, andcorroborate this result by means of numerical simulations.

The paper considers the problem of reconstructing a probability density function from a finite set of samples independently drawn from it. We cast the problem in a Bayesian setting where the unknown density is modeled via a nonlinear transformation of a Bayesian prior placed on a Reproducing Kernel Hilbert Space. The learning of the unknown density function is then formulated as a minimum variance estimation problem. Since this requires the solution of analytically intractable integrals, we solve this problem by proposing a novel algorithm based on the Markov chain Monte Carlo framework. Simulations are used to corroborate the goodness of the new approach.

To maintain and organize distributed systems it is necessary to have a certain degree of knowledge of their status like the number of cooperating agents. The estimation of this number, usually referred as the network size, can pose challenging questions when agents' identification information cannot be disclosed, since the exchanged information cannot be associated to who originated it. In this paper we propose a totally distributed network size estimation strategy based on statistical inference concepts that can be applied under anonymity constraints. The scheme is based on the following paradigm: agents locally generate some Bernoulli trials, then distributedly compute averages of these generated data, finally locally compute the Maximum Likelihood estimate of the network size exploiting its probabilistic dependencies with the previously computed averages. In this work we study the statistical properties of this estimation strategy, and show how the probability of returning a wrong evaluation decreases exponentially in the number of locally generated trials. Finally, we discuss how practical implementation issues may affect the estimator, and show that there exists a neat phase transition between insensitivity to numerical errors and uselessness of the results.

We consider the problem of commanding the electronic power interfaces of the microgenerators in a low voltage microgrid for the task of optimal reactive power compensation. In this work, we analyze the convergence of the strategy proposed by Tenti et al. in 2012. The proof of convergence gives some additional insight on the behavior of the algorithm and allows the characterization of its rate of convergence as a function of the microgrid parameters.

We consider how a set of collaborating agents can distributedly infer some of theproperties of the communication network that they form. We specifically focus on estimatingquantities that can characterize the performance of other distributed algorithms, namely theeccentricities of the nodes, and the radius and diameter of the network. We propose a strategythat can be implemented in any network, even under anonymity constraints, and has thedesirable properties of being fully distributed, parallel and scalable. We analytically characterizethe statistics of the estimation error, and highlight how the performance of the algorithmdepends on a parameter tuning the communication complexity.

In this paper we address the problem of exploitingthe distributed energy resources (DER) available in a smartmicro-grid to minimize the power distribution losses via optimalreactive power compensation. Due to their typically smallsize, the amount of reactive power provided by each micro-generator is subject to tight saturation constraints. As aconsequence, it might be impossible to achieve convergence tothe global optimum based on algorithms that rely on short-range, gossip-type communication. We therefore propose arandomized multi-hop protocol that guarantees convergence ofthe distributed optimization algorithm also when only short-range communications are possible, at the expense of someadditional communication overhead.

In this paper we focus on collaborative wireless sensor networks, where agents are randomly distributed over a region of interest and collaborate to achieve a common estimation goal. In particular, we introduce two consensus-based distributed linear estimators. The first one is designed for a Bayesian scenario, where an unknown common finite-dimensional parameter vector has to be reconstructed,  while the second one  regards the nonparametric reconstruction of an unknown function sampled at different locations by the sensors. Both of the algorithms are characterized in terms of the trade-off between estimation performance, communication, computation and memory complexity. In the finite-dimensional setting, we derive mild sufficient conditions which ensure that distributed estimator performs better than the local optimal ones in terms of estimation error variance. In the nonparametric setting, we introduce an on-line algorithm that allows the agents both to compute the function estimate with small computational, communication and data storage efforts, and to quantify its distance from the centralized estimate given by a Regularization Network, one of the most powerful regularized kernel methods. These results are obtained by deriving bounds on the estimation error that provide insights on how the uncertainty inherent in a sensor network, such as imperfect knowledge on the number of agents and the measurement models used by the sensors, can degrade the performance of the estimation process. Numerical experiments are included to support the theoretical findings.

We consider the problem of estimating the size of dynamic anonymous networks, motivated by network maintenance. The proposed algorithm is based on max-consensus information exchange protocols, and extends a previous algorithm for static anonymous networks. A regularization term is accounting for a-priori assumptions on the smoothness of the estimate, and we specifically consider quadratic regularization terms since they lead to closed-form solutions and intuitive design laws. We derive an explicit estimation scheme for a particular peer-to-peer service network, starting from its statistical model. To validate the accuracy of the algorithm, we perform numerical experiments and show how the algorithm can be implemented using finite precision arithmetics as well as small communication burdens.

In this paper we study the problem of real-time optimal distributed partitioning for perimeter patrolling in the context of multi-camera networks for surveillance. The objective is to partition a given segment into non-overlapping sub-segments, each assigned to a different camera to patrol. Each camera has both physical mobility range and limited speed, and it must patrol its assigned sub-segment by sweeping it back and forth at maximum speed. Here we first review the solution for the centralized optimal partitioning. Then we propose two different distributed control strategies to determine the extremes of the optimal patrolling areas of each camera. Both these strategies require only local communication with the neighboring cameras but adopt different communication schemes, respectively, symmetric gossip and asynchronous asymmetric broadcast. The first scheme is shown to be provably convergent to the optimal solution. Some theoretical insights are provided also for the second scheme whose effectiveness is validated through numerical simulations.

In this work we consider a multidimensional distributed optimization technique that is suitable for multiagents systems subject to limited communication connectivity. In particular, we consider a convex unconstrained additive problem, i.e. a case where the global convex unconstrained multidimensional cost function is given by the sum of local cost functions available only to the specific owning agents. We show how, by exploiting the separation of time-scales principle,the multidimensional consensus-based strategy approximates a Newton-Raphson descent algorithm. We propose two alternative optimization strategies corresponding to approximations of the main procedure. These approximations introduce tradeoffs between the required communication bandwidth and the convergence speed/accuracy of the results. We provide analytical proofs of convergence and numerical simulations supporting the intuitions developed through the paper.

Geometric triangulation is at the basis of the estimation of the 3D position of a target from a set of camera measurements. The problem of optimal estimation (minimizing the L2 norm) of the target position from multi-view perspective projective measurements is typically a hard problem to solve. In literature there are different types of algorithms for this purpose, based for example on the exhaustive check of all the local minima of a proper eigenvalue problem [2], or branch- and-bound techniques [3]. However, such methods typically become unfeasible for real time applications when the number of cameras and targets become large, calling for the definition of approximate procedures to solve the reconstruction problem.
In the first part of this paper, linear (fast) algorithms, computing an approximate solution to such problems, are described and compared in simulation. Then, in the second part, a Gaussian approximation to the measurement error is used to express the reconstruction error’s standard deviation as a function of the position of the reconstructed point. An upper bound, valid over all the target domain, to this expression is obtained for a case of interest. Such upper bound allows to compute a number of cameras sufficient to obtain a user defined level of position estimation accuracy.

We consider the convergence rates of two peculiar2 convex optimization strategies in the context of multi agent3 systems, namely the Newton-Raphson consensus optimization4 and a distributed Gradient-Descent opportunely derived from5 the first. To allow analytical derivations, the convergence6 analyses are performed under the simplificative assumption of7 quadratic local cost functions. In this framework we derive8 sufficient conditions which guarantee the convergence of the9 algorithms. From these conditions we then obtain closed form10 expressions that can be used to tune the parameters for11 maximizing the rate of convergence. Despite these formulae12 have been derived under quadratic local cost functions13 assumptions, they can be used as rules-of-thumb for tuning14 the parameters of the algorithms in general situations.

We consider the scenario of a low voltage microgrid populated by a number of distributed microgenerators. We focus on the problem of obtaining a dynamic model that describes the input-output relation between complex power commands sent to the microgenerator inverters and the voltage measurements across the network. Such a model is intended as a necessary tool in the design of distributed and centralized control algorithms for the provision of ancillary services in the power distribution grid. Because this model is to be used for the design of such algorithms, we look for an analytical derivation instead of a simulative tool. The proposed model is linear and explicitly contains the network parameters and topology. Simulation shows how the proposed model approximates well the behavior of the original nonlinear system.

We consider the problem of optimal reactive power compensation for the minimization of power distribution losses in a smart microgrid. We first propose an approximate model for the power distribution network, which allows us to cast the problem into the class of convex quadratic, linearly constrained, optimization problems.

We also show how this model provides the tools for a distributed approach, in which agents have a partial knowledge of the problem parameters and state, and can only perform local measurements.

Then, we design a randomized, gossip-like optimization algorithm, providing conditions for convergence together with an analytical characterization of the convergence speed. The analysis shows that the best performance can be achieved when we command cooperation among agents that are neighbors in the smart microgrid topology. Numerical simulations are included to validate the proposed model and to confirm the analytical results about the performance of the proposed algorithm.

In this work we study the problem of unconstrained distributed optimization in the context of multi-agents systems subject to limited communication connectivity. In particular we focus on the minimization of a sum of convex cost functions, where each component of the global function is available only to a specific agent and can thus be seen as a private local cost. The agents need to cooperate to compute the minimizer of the sum of all costs. We propose a consensus-like strategy to estimate a Newton-Raphson descending update for the local estimates of the global minimizer at each agent. In particular, the algorithm is based on the separation of time-scales principle and it is proved to converge to the global minimizer if a specific parameter that tunes the rate of convergence is chosen sufficiently small. We also provide numerical simulations and compare them with alternative distributed optimization strategies like the Alternating Direction Method of Multipliers and the Distributed Subgradient Method.

We analyze the problem of data sets reduction

for support vector classification. The work is also motivated

by distributed problems, where sensors collect binary mea-

surements at different locations moving inside an environment

that needs to be divided into a collection of regions labeled in

two different ways. The scope is to let each agent retain and

exchange only those measurements that are mostly informative

for the collective reconstruction of the decision boundary. For

the case of separable classes, we provide the exact conditions

and an efficient algorithm to determine if an element in the

training set can become a support vector when new data arrive.

The analysis is then extended to the non-separable case deriving

a sufficient discardability condition and a general data selection

scheme for classification. Numerical experiments relative to the

distributed problem show that the proposed procedure allows

the agents to exchange a small amount of the collected data to

obtain a highly predictive decision boundary.