Two approaches to optimal annealing

Todd K. Leen, Bernhard Schottky, David Saad

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

We employ both master equation and order parameter approaches to analyze the asymptotic dynamics of on-line learning with different learning rate annealing schedules. We examine the relations between the results obtained by the two approaches and obtain new results on the optimal decay coefficients and their dependence on the number of hidden nodes in a two layer architecture.

Original languageEnglish (US)
Title of host publicationAdvances in Neural Information Processing Systems
PublisherNeural information processing systems foundation
Pages301-307
Number of pages7
ISBN (Print)0262100762, 9780262100762
StatePublished - 1998
Event11th Annual Conference on Neural Information Processing Systems, NIPS 1997 - Denver, CO, United States
Duration: Dec 1 1997Dec 6 1997

Other

Other11th Annual Conference on Neural Information Processing Systems, NIPS 1997
CountryUnited States
CityDenver, CO
Period12/1/9712/6/97

Fingerprint

Annealing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Signal Processing

Cite this

Leen, T. K., Schottky, B., & Saad, D. (1998). Two approaches to optimal annealing. In Advances in Neural Information Processing Systems (pp. 301-307). Neural information processing systems foundation.

Two approaches to optimal annealing. / Leen, Todd K.; Schottky, Bernhard; Saad, David.

Advances in Neural Information Processing Systems. Neural information processing systems foundation, 1998. p. 301-307.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Leen, TK, Schottky, B & Saad, D 1998, Two approaches to optimal annealing. in Advances in Neural Information Processing Systems. Neural information processing systems foundation, pp. 301-307, 11th Annual Conference on Neural Information Processing Systems, NIPS 1997, Denver, CO, United States, 12/1/97.
Leen TK, Schottky B, Saad D. Two approaches to optimal annealing. In Advances in Neural Information Processing Systems. Neural information processing systems foundation. 1998. p. 301-307
Leen, Todd K. ; Schottky, Bernhard ; Saad, David. / Two approaches to optimal annealing. Advances in Neural Information Processing Systems. Neural information processing systems foundation, 1998. pp. 301-307
@inproceedings{4a270263824d4a3aa2c9a56e8c9b5f71,
title = "Two approaches to optimal annealing",
abstract = "We employ both master equation and order parameter approaches to analyze the asymptotic dynamics of on-line learning with different learning rate annealing schedules. We examine the relations between the results obtained by the two approaches and obtain new results on the optimal decay coefficients and their dependence on the number of hidden nodes in a two layer architecture.",
author = "Leen, {Todd K.} and Bernhard Schottky and David Saad",
year = "1998",
language = "English (US)",
isbn = "0262100762",
pages = "301--307",
booktitle = "Advances in Neural Information Processing Systems",
publisher = "Neural information processing systems foundation",

}

TY - GEN

T1 - Two approaches to optimal annealing

AU - Leen, Todd K.

AU - Schottky, Bernhard

AU - Saad, David

PY - 1998

Y1 - 1998

N2 - We employ both master equation and order parameter approaches to analyze the asymptotic dynamics of on-line learning with different learning rate annealing schedules. We examine the relations between the results obtained by the two approaches and obtain new results on the optimal decay coefficients and their dependence on the number of hidden nodes in a two layer architecture.

AB - We employ both master equation and order parameter approaches to analyze the asymptotic dynamics of on-line learning with different learning rate annealing schedules. We examine the relations between the results obtained by the two approaches and obtain new results on the optimal decay coefficients and their dependence on the number of hidden nodes in a two layer architecture.

UR - http://www.scopus.com/inward/record.url?scp=84898928674&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84898928674&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84898928674

SN - 0262100762

SN - 9780262100762

SP - 301

EP - 307

BT - Advances in Neural Information Processing Systems

PB - Neural information processing systems foundation

ER -