-
Extended Signaling Methods for Reduced Video Decoder Power Consumption Using Green Metadata
Authors:
Christian Herglotz,
Matthias Kränzler,
Xixue Chu,
Edouard Francois,
Yong He,
André Kaup
Abstract:
In this paper, we discuss one aspect of the latest MPEG standard edition on energy-efficient media consumption, also known as Green Metadata (ISO/IEC 232001-11), which is the interactive signaling for remote decoder-power reduction for peer-to-peer video conferencing. In this scenario, the receiver of a video, e.g., a battery-driven portable device, can send a dedicated request to the sender which…
▽ More
In this paper, we discuss one aspect of the latest MPEG standard edition on energy-efficient media consumption, also known as Green Metadata (ISO/IEC 232001-11), which is the interactive signaling for remote decoder-power reduction for peer-to-peer video conferencing. In this scenario, the receiver of a video, e.g., a battery-driven portable device, can send a dedicated request to the sender which asks for a video bitstream representation that is less complex to decode and process. Consequently, the receiver saves energy and extends operating times. We provide an overview on latest studies from the literature dealing with energy-saving aspects, which motivate the extension of the legacy Green Metadata standard. Furthermore, we explain the newly introduced syntax elements and verify their effectiveness by performing dedicated experiments. We show that the integration of these syntax elements can lead to dynamic energy savings of up to 90% for software video decoding and 80% for hardware video decoding, respectively.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
Deep-based Film Grain Removal and Synthesis
Authors:
Zoubida Ameur,
Wassim Hamidouche,
Edouard François,
Miloš Radosavljević,
Daniel Menard,
Claire-Hélène Demarty
Abstract:
In this paper, deep learning-based techniques for film grain removal and synthesis that can be applied in video coding are proposed. Film grain is inherent in analog film content because of the physical process of capturing images and video on film. It can also be present in digital content where it is purposely added to reflect the era of analog film and to evoke certain emotions in the viewer or…
▽ More
In this paper, deep learning-based techniques for film grain removal and synthesis that can be applied in video coding are proposed. Film grain is inherent in analog film content because of the physical process of capturing images and video on film. It can also be present in digital content where it is purposely added to reflect the era of analog film and to evoke certain emotions in the viewer or enhance the perceived quality. In the context of video coding, the random nature of film grain makes it both difficult to preserve and very expensive to compress. To better preserve it while compressing the content efficiently, film grain is removed and modeled before video encoding and then restored after video decoding. In this paper, a film grain removal model based on an encoder-decoder architecture and a film grain synthesis model based on a \ac{cgan} are proposed. Both models are trained on a large dataset of pairs of clean (grain-free) and grainy images. Quantitative and qualitative evaluations of the developed solutions were conducted and showed that the proposed film grain removal model is effective in filtering film grain at different intensity levels using two configurations: 1) a non-blind configuration where the film grain level of the grainy input is known and provided as input, 2) a blind configuration where the film grain level is unknown. As for the film grain synthesis task, the experimental results show that the proposed model is able to reproduce realistic film grain with a controllable intensity level specified as input.
△ Less
Submitted 15 June, 2022;
originally announced June 2022.
-
A terrain treadmill to study animal locomotion through large obstacles
Authors:
Ratan Othayoth,
Blake Strebel,
Yuanfeng Han,
Evains Francois,
Chen Li
Abstract:
A major challenge to understanding locomotion in complex 3-D terrain with large obstacles is to create tools for controlled, systematic lab experiments. Existing terrain arenas only allow observations at small spatiotemporal scales (~10 body length, ~10 stride cycles). Here, we create a terrain treadmill to enable high-resolution observations of animal locomotion through large obstacles over large…
▽ More
A major challenge to understanding locomotion in complex 3-D terrain with large obstacles is to create tools for controlled, systematic lab experiments. Existing terrain arenas only allow observations at small spatiotemporal scales (~10 body length, ~10 stride cycles). Here, we create a terrain treadmill to enable high-resolution observations of animal locomotion through large obstacles over large spatiotemporal scales. An animal moves through modular obstacles on an inner sphere, while a rigidly-attached, concentric, transparent outer sphere rotated with the opposite velocity via closed-loop feedback to keep the animal on top. During sustained locomotion, a discoid cockroach moved through pillar obstacles for 25 minutes ($\approx$2500 strides) over 67 m ($\approx$1500 body lengths), and was contained within a radius of 4 cm (0.9 body length) for 83% of the duration, even at speeds of up to 10 body length/s. The treadmill enabled observation of diverse locomotor behaviors and quantification of animal-obstacle interaction.
△ Less
Submitted 14 December, 2021;
originally announced December 2021.
-
Versatile Video Coding Standard: A Review from Coding Tools to Consumers Deployment
Authors:
Wassim Hamidouche,
Thibaud Biatek,
Mohsen Abdoli,
Edouard François,
Fernando Pescador,
Miloš Radosavljević,
Daniel Menard,
Mickael Raulet
Abstract:
The amount of video content and the number of applications based on multimedia information increase each day. The development of new video coding standards is a challenge to increase the compression rate and other important features with a reasonable increase in the computational load. Video Experts Team (JVET) of ITU-T and the JCT group within ISO/IEC have worked together to standardize the Versa…
▽ More
The amount of video content and the number of applications based on multimedia information increase each day. The development of new video coding standards is a challenge to increase the compression rate and other important features with a reasonable increase in the computational load. Video Experts Team (JVET) of ITU-T and the JCT group within ISO/IEC have worked together to standardize the Versatile Video Coding, approved finally in July 2020 as ITU-T H.266 | MPEG-I - Part 3 (ISO/IEC 23090-3) standard. This paper overviews some interesting consumer electronic use cases, the compression tools described in the standard, the current available real time implementations and the first industrial trials done with this standard.
△ Less
Submitted 6 November, 2021; v1 submitted 27 June, 2021;
originally announced June 2021.
-
Shape-induced obstacle attraction and repulsion during dynamic locomotion
Authors:
Yuanfeng Han,
Ratan Othayoth,
Yulong Wang,
Chun-Cheng Hsu,
Rafael de la Tijera Obert,
Evains Francois,
Chen Li
Abstract:
Robots still struggle to dynamically traverse complex 3-D terrain with many large obstacles, an ability required for many critical applications. Body-obstacle interaction is often inevitable and induces perturbation and uncertainty in motion that challenges closed-form dynamic modeling. Here, inspired by recent discovery of a terradynamic streamlined shape, we studied how two body shapes interacti…
▽ More
Robots still struggle to dynamically traverse complex 3-D terrain with many large obstacles, an ability required for many critical applications. Body-obstacle interaction is often inevitable and induces perturbation and uncertainty in motion that challenges closed-form dynamic modeling. Here, inspired by recent discovery of a terradynamic streamlined shape, we studied how two body shapes interacting with obstacles affect turning and pitching motions of an open-loop multi-legged robot and cockroaches during dynamic locomotion. With a common cuboidal body, the robot was attracted towards obstacles, resulting in pitching up and flipping-over. By contrast, with an elliptical body, the robot was repelled by obstacles and readily traversed. The animal displayed qualitatively similar turning and pitching motions induced by these two body shapes. However, unlike the cuboidal robot, the cuboidal animal was capable of escaping obstacle attraction and subsequent high pitching and flipping over, which inspired us to develop an empirical pitch-and-turn strategy for cuboidal robots. Considering the similarity of our self-propelled body-obstacle interaction with part-feeder interaction in robotic part manipulation, we developed a quasi-static potential energy landscape model to explain the dependence of dynamic locomotion on body shape. Our experimental and modeling results also demonstrated that obstacle attraction or repulsion is an inherent property of locomotor body shape and insensitive to obstacle geometry and size. Our study expanded the concept and usefulness of terradynamic shapes for passive control of robot locomotion to traverse large obstacles using physical interaction. Our study is also a step in establishing an energy landscape approach to locomotor transitions.
△ Less
Submitted 15 March, 2021;
originally announced March 2021.
-
CNN-based driving of block partitioning for intra slices encoding
Authors:
Franck Galpin,
Fabien Racapé,
Sunil Jaiswal,
Philippe Bordes,
Fabrice Le Léannec,
Edouard François
Abstract:
This paper provides a technical overview of a deep-learning-based encoder method aiming at optimizing next generation hybrid video encoders for driving the block partitioning in intra slices. An encoding approach based on Convolutional Neural Networks is explored to partly substitute classical heuristics-based encoder speed-ups by a systematic and automatic process. The solution allows controlling…
▽ More
This paper provides a technical overview of a deep-learning-based encoder method aiming at optimizing next generation hybrid video encoders for driving the block partitioning in intra slices. An encoding approach based on Convolutional Neural Networks is explored to partly substitute classical heuristics-based encoder speed-ups by a systematic and automatic process. The solution allows controlling the trade-off between complexity and coding gains, in intra slices, with one single parameter. This algorithm was proposed at the Call for Proposals of the Joint Video Exploration Team (JVET) on video compression with capability beyond HEVC. In All Intra configuration, for a given allowed topology of splits, a speed-up of $\times 2$ is obtained without BD-rate loss, or a speed-up above $\times 4$ with a loss below 1\% in BD-rate.
△ Less
Submitted 12 November, 2020;
originally announced November 2020.
-
A fourth order gauge-invariant gradient plasticity model for polycrystals based on Kröner's incompatibility tensor
Authors:
Francois Ebobisse,
Patrizio Neff
Abstract:
In this paper we derive a novel fourth order gauge-invariant phenomenological model of infinitesimal rate-independent gradient plasticity with isotropic hardening and Kröner's incompatibility tensor $inc(ε_p):= Curl[(Curl ε_p)^T]$, where $ε_p=sym p$ is the symmetric infinitesimal plastic strain tensor and $p$ is the (non-symmetric) infinitesimal plastic distortion. Here, gauge-invariance denotes…
▽ More
In this paper we derive a novel fourth order gauge-invariant phenomenological model of infinitesimal rate-independent gradient plasticity with isotropic hardening and Kröner's incompatibility tensor $inc(ε_p):= Curl[(Curl ε_p)^T]$, where $ε_p=sym p$ is the symmetric infinitesimal plastic strain tensor and $p$ is the (non-symmetric) infinitesimal plastic distortion. Here, gauge-invariance denotes invariance under diffeomorphic reparametrizations of the reference configuration, suitably adapted to the geometrically linear setting. The model features a defect energy contribution which is quadratic in the tensor $inc(ε_p)$ and it contains isotropic hardening based on the rate of the symmetric infinitesimal plastic strain tensor $\dot{ε_p}$. We motivate the new model by introducing a novel rotational invariance requirement in gradient plasticity, which we call micro-randomness, suitable for the description of polycrystalline aggregates on a mesoscopic scale and not coinciding with classical isotropy requirements. This new condition effectively reduces the increments of the non-symmetric infinitesimal plastic distortion $\dot{p}$ to their symmetric counterpart $\dot{ε_p}$. In the polycrystalline case, this condition is a statement about insensitivity to arbitrary superposed grain rotations. We formulate a mathematical existence result for a suitably regularized non-gauge-invariant model. The regularized model is rather invariant under reparametrizations of the reference configuration including infinitesimal conformal mappings.
△ Less
Submitted 4 April, 2019; v1 submitted 27 June, 2017;
originally announced June 2017.
-
Existence result for a dislocation based model of single crystal gradient plasticity with isotropic or linear kinematic hardening
Authors:
Francois Ebobisse,
Patrizio Neff,
Elias C. Aifantis
Abstract:
We consider a dislocation-based rate-independent model of single crystal gradient plasticity with isotropic or linear kinematic hardening. The model is weakly formulated through the so-called primal form of the flow rule as a variational inequality for which a result of existence and uniqueness is obtained using the functional analytical framework developed by Han-Reddy.
We consider a dislocation-based rate-independent model of single crystal gradient plasticity with isotropic or linear kinematic hardening. The model is weakly formulated through the so-called primal form of the flow rule as a variational inequality for which a result of existence and uniqueness is obtained using the functional analytical framework developed by Han-Reddy.
△ Less
Submitted 16 September, 2016;
originally announced September 2016.
-
Well-posedness for the microcurl model in both single and polycrystal gradient plasticity
Authors:
Francois Ebobisse,
Patrizio Neff,
Samuel Forest
Abstract:
We consider the recently introduced microcurl model which is a variant of strain gradient plasticity in which the curl of the plastic distortion is coupled to an additional micromorphic-type field. For both single crystal and polycrystal cases, we formulate the model and show its well-posedness in the rate-independent case provided some local hardening (isotropic or linear kinematic) is taken into…
▽ More
We consider the recently introduced microcurl model which is a variant of strain gradient plasticity in which the curl of the plastic distortion is coupled to an additional micromorphic-type field. For both single crystal and polycrystal cases, we formulate the model and show its well-posedness in the rate-independent case provided some local hardening (isotropic or linear kinematic) is taken into account. To this end, we use the functional analytical framework developed by Han-Reddy. We also compare the model to the relaxed micromorphic model as well as to a dislocation-based gradient plasticity model.
△ Less
Submitted 22 August, 2016;
originally announced August 2016.
-
A canonical rate-independent model of geometrically linear isotropic gradient plasticity with isotropic hardening and plastic spin accounting for the Burgers vector
Authors:
Francois Ebobisse,
Klaus Hackl,
Patrizio Neff
Abstract:
In this paper we propose a canonical variational framework for rate-independent phenomenological geometrically linear gradient plasticity with plastic spin. The model combines the additive decomposition of the total distortion into non-symmetric elastic and plastic distortions, with a defect energy contribution taking account of the Burgers vector through a dependence only on the dislocation densi…
▽ More
In this paper we propose a canonical variational framework for rate-independent phenomenological geometrically linear gradient plasticity with plastic spin. The model combines the additive decomposition of the total distortion into non-symmetric elastic and plastic distortions, with a defect energy contribution taking account of the Burgers vector through a dependence only on the dislocation density tensor Curl(p) giving rise to a non-symmetric nonlocal backstress, and isotropic hardening response only depending on the accumulated equivalent plastic strain. The model is fully isotropic and satisfies linearized gauge-invariance conditions, i.e., only true state-variables appear. The model satisfies also the principle of maximum dissipation which allows to show existence for the weak formulation. For this result, a recently introduced Korn's inequality for incompatible tensor fields is necessary. Uniqueness is shown in the class of strong solutions. For vanishing energetic length scale, the model reduces to classical elasto-plasticity with symmetric plastic strain sym(p) and standard isotropic hardening.
△ Less
Submitted 4 April, 2019; v1 submitted 1 March, 2016;
originally announced March 2016.
-
A lower semicontinuity result for some integral functionals in the space SBD
Authors:
Francois Ebobisse
Abstract:
The purpose of this paper is to study the lower semicontinuity with respect to the strong $L^1$-convergence, of some integral functionals defined in the space SBD of special functions with bounded deformation. Precisely, let $U$ be a bounded open subset of $R^n$. If $u\in $SBD$(U)$, $(u_h)\subset $SBD$(U)$ converges to $u$ strongly in $L^1(U,R^n)$ and the measures $|E^ju_h|$ converge weakly * to…
▽ More
The purpose of this paper is to study the lower semicontinuity with respect to the strong $L^1$-convergence, of some integral functionals defined in the space SBD of special functions with bounded deformation. Precisely, let $U$ be a bounded open subset of $R^n$. If $u\in $SBD$(U)$, $(u_h)\subset $SBD$(U)$ converges to $u$ strongly in $L^1(U,R^n)$ and the measures $|E^ju_h|$ converge weakly * to a measure $ν$ singular with respect to the Lebesgue measure, then $$\int_Uf(x,{\mathcal E}u)dx\leq\liminf_{h\to\infty} \int_Uf(x,{\mathcal E}u_h)dx$$ provided $f$ satisfies some weak convexity property and the standard growth assumptions of order $p>1$.
△ Less
Submitted 30 June, 2003;
originally announced June 2003.
