February 5, 2007
In this pedagogical article, we present a simple direct matrix method for analytically computing the Jacobian of nonlinear algebraic equations that arise from the discretization of nonlinear integro-differential equations. The method is based on a formulation of the discretized equations in vector form using only matrix-vector products and component-wise operations. By applying simple matrix-based differentiation rules, the matrix form of the analytical Jacobian can be calculated with little more difficulty than that required when computing derivatives in single-variable calculus. After describing the direct matrix method, we present numerical experiments demonstrating the computational performance of the method, discuss its connection to the Newton-Kantorovich method, and apply it to illustrative 1D and 2D example problems. MATLAB code is provided to demonstrate the low code complexity required by the method.
Similar papers 1
April 15, 1999
By using the Hadamard matrix product concept, this paper introduces two generalized matrix formulation forms of numerical analogue of nonlinear differential operators. The SJT matrix-vector product approach is found to be a simple, efficient and accurate technique in the calculation of the Jacobian matrix of the nonlinear discretization by finite difference, finite volume, collocation, dual reciprocity BEM or radial functions based numerical methods. We also present and prove...
December 10, 2020
Differential Equations are among the most important Mathematical tools used in creating models in the science, engineering, economics, mathematics, physics, aeronautics, astronomy, dynamics, biology, chemistry, medicine, environmental sciences, social sciences, banking and many other areas [7]. A differential equation that has only one independent variable is called an Ordinary Differential Equation (ODE), and all derivatives in it are taken with respect to that variable. Mos...
February 14, 2017
In this paper an extension of the spectral Lanczos' tau method to systems of nonlinear integro-differential equations is proposed. This extension includes (i) linearization coefficients of orthogonal polynomials products issued from nonlinear terms and (ii) recursive relations to implement matrix inversion whenever a polynomial change of basis is required and (iii) orthogonal polynomial evaluations directly on the orthogonal basis. All these improvements ensure numerical stab...
May 2, 2023
A modification of Newton's method for solving systems of $n$ nonlinear equations is presented. The new matrix-free method relies on a given decomposition of the invertible Jacobian of the residual into invertible sparse local Jacobians according to the chain rule of differentiation. It is motivated in the context of local Jacobians with bandwidth $2m+1$ for $m\ll n$. A reduction of the computational cost by $\mathcal{O}(\frac{n}{m})$ can be observed. Supporting run time measu...
October 20, 2019
The systems of nonlinear Volterra integral equations of the first kind with jump discontinuous kernels are studied. The iterative numerical method for such nonlinear systems is proposed. Proposed method employs the modified Newton-Kantorovich iterative process for the integral operators linearization. On each step of the iterative process the linear system of integral equations is obtained and resolved using the discontinuity driven piecewise constant approximation of the exa...
August 3, 2020
In this work, a new technique has been presented to find approximate solution of linear integro-differential equations. The method is based on modified orthonormal Bernoulli polynomials and an operational matrix thereof. The method converts a given integro-differential equation into a set of algebraic equations with unknown coefficients, which is easily obtained with help of the known functions appearing in the equation, modified Bernoulli polynomials and operational matrix. ...
September 22, 2020
We propose a novel direct transcription and solution method for solving nonlinear, continuous-time dynamic optimization problems. Instead of forcing the dynamic constraints to be satisfied only at a selected number of points as in direct collocation, the new approach alternates between minimizing and constraining the squared norm of the dynamic constraint residuals integrated along the whole solution trajectories. As a result, the method can 1) obtain solutions of higher accu...
June 1, 2018
Numerical integration (NI) packages commonly used in scientific research are limited to returning the value of a definite integral at the upper integration limit, also commonly referred to as numerical quadrature. These quadrature algorithms are typically of a fixed accuracy and have only limited ability to adapt to the application. In this article, we will present a highly adaptive algorithm that not only can efficiently compute definite integrals encountered in physical pro...
February 24, 2016
This paper present a numerical method for solving nonlinear Fredholm integral equations. The method is based upon Newton type approximations. Illustrative examples are included to demonstrate the validity and applicability of the technique.
July 29, 2013
The paper presents a new method for finding first integrals of ordinary difference equations which do not possess Lagrangians, nor Hamiltonians. As an example we solve a third order nonlinear ordinary differential equation and its invariant discretization using three first integrals obtained using this method.